-- Logs begin at Mon 2022-09-26 16:59:25 UTC, end at Mon 2022-09-26 18:20:46 UTC. -- Sep 26 17:48:30.015481 dv-cinder-859317-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 17:48:30.024113 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 17:48:30 2022] *** Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: nodename: dv-cinder-859317-1-iscsi Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: machine: x86_64 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: clock source: unix Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: pcre jit disabled Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: detected number of CPU cores: 4 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: current working directory: / Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: detected binary path: /usr/bin/uwsgi-core Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: your processes number limit is 47680 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: your memory page size is 4096 bytes Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: detected max file descriptor number: 2048 Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: lock engine: pthread robust mutexes Sep 26 17:48:30.026995 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: thunder lock: enabled Sep 26 17:48:30.027827 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 17:48:30.027827 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 17:48:30.066688 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: Python main interpreter initialized at 0x55fa72fd39c0 Sep 26 17:48:30.066688 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: python threads support enabled Sep 26 17:48:30.066688 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: your server socket listen backlog is limited to 100 connections Sep 26 17:48:30.066688 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: your mercy for graceful operations on workers is 90 seconds Sep 26 17:48:30.067050 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 17:48:30.067130 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: *** Operational MODE: preforking *** Sep 26 17:48:30.067360 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: *** uWSGI is running in multiple interpreter mode *** Sep 26 17:48:30.067360 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: spawned uWSGI master process (pid: 117516) Sep 26 17:48:30.067552 dv-cinder-859317-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 17:48:30.068261 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: spawned uWSGI worker 1 (pid: 117517, cores: 1) Sep 26 17:48:30.068455 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: spawned uWSGI worker 2 (pid: 117518, cores: 1) Sep 26 17:48:30.069319 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 17:48:30.724321 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:48:30.726676 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:48:31.800045 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:48:31.800045 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: from cryptography.utils import int_from_bytes Sep 26 17:48:31.800627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:48:31.800627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: from cryptography.utils import int_from_bytes Sep 26 17:48:31.801554 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:48:31.801554 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: from cryptography.utils import int_from_bytes Sep 26 17:48:31.801973 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:48:31.801973 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: from cryptography.utils import int_from_bytes Sep 26 17:48:34.291612 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:48:34.292173 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:48:34.292385 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:48:34.292571 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:48:34.293002 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:48:34.293096 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:48:34.293195 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:48:34.293409 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:48:34.293529 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.293705 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.293820 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:48:34.293968 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:48:34.294062 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.294331 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.294424 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.294659 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.294752 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.294969 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295075 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295285 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295371 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295634 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295730 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.295931 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296022 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296190 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296291 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296503 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296616 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296827 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859317-1-iscsi {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.296950 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297148 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297264 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297481 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297615 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297793 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.297884 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859317-1-iscsi {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.298111 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.298203 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.298669 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.298776 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.299516 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.299606 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.299823 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.299916 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.300134 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.300326 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.300458 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.300771 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.300874 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301074 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301290 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301393 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301603 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301740 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.301912 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302070 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302188 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302337 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302566 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302717 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302838 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.302986 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303118 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303264 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303596 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303739 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.303932 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859317-1-iscsi {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304093 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304266 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304387 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304561 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304720 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859317-1-iscsi {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.304893 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.305016 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.305372 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.305519 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.305694 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.305819 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306003 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306108 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306322 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306425 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306639 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306733 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.306946 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307038 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307270 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307364 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307585 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307692 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.307902 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308002 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308219 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308321 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308515 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308607 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308818 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.308918 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309124 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309239 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309460 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309555 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309759 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.309853 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310061 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310162 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310307 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310393 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310613 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310711 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310886 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.310970 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311197 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311281 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311519 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311615 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311774 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.311857 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312022 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312147 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312337 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312431 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312639 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312810 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.312965 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313107 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313287 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313436 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313616 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313757 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.313894 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.314043 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.314181 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.314316 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.314452 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315158 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315309 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315455 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315600 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315737 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.315878 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316020 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316251 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316406 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316544 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316680 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316815 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.316950 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317092 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317380 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317380 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317657 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317804 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.317946 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318091 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318228 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318388 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318538 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318683 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.318837 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319058 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319201 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319361 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319497 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319642 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319780 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.319933 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320077 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320215 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320349 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320491 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320627 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320771 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.320914 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321051 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321196 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321396 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321546 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321682 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321819 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.321954 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322089 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322223 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322372 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322509 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322645 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322779 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.322925 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323061 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323209 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323345 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323480 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323666 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323810 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.323952 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324098 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324235 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324369 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324638 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324792 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.324929 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325064 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325317 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325465 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325622 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325778 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.325915 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326059 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326195 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326424 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326567 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326713 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.326865 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327003 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327139 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327274 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327409 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327553 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327689 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.327832 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328050 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328195 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328331 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328479 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328622 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328768 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.328913 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329068 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329308 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329463 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329609 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329745 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.329879 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330020 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330156 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330437 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330580 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330727 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.330869 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331005 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331149 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331286 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331422 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331557 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331699 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331849 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.331994 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332131 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332268 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332410 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332557 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332701 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.332837 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333002 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333156 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333341 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333480 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333632 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333811 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.333951 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334094 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334231 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334385 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334532 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334668 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334802 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.334943 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335086 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335222 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335370 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335508 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335643 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335784 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.335947 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.336251 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.336435 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.336645 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.336797 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.336934 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.337069 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.337216 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.337418 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.337556 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.337690 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.337825 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:48:34.337959 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338140 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338294 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338473 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338618 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338789 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.338940 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339103 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339262 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339470 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339613 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339749 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.339893 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340029 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340163 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340314 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340457 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340603 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340748 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.340921 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341071 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341260 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341368 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341593 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341714 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341911 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.341998 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342224 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342310 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342540 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342639 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342855 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.342956 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343173 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343278 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343487 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343586 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343803 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.343887 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344110 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344194 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344426 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344511 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344755 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.344839 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345069 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345154 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345418 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345503 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345763 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.345847 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346075 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346160 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346386 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346479 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346696 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.346780 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347031 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347115 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347340 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347437 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347650 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347733 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.347966 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348058 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348279 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348363 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348596 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348680 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.348906 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349074 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349214 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349329 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349555 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349636 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349862 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.349956 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350173 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350260 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350485 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350568 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350802 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.350894 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351115 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351200 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351424 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351507 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351733 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.351828 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352047 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352132 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352357 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352447 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352666 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352764 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.352978 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353062 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353308 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353396 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353616 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353714 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.353917 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354010 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354223 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354315 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354544 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354635 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354829 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.354913 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355136 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355220 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355442 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355527 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355746 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.355830 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356058 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356151 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356367 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356452 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356677 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356759 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.356985 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357076 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357309 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357397 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357622 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357704 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.357931 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358034 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358234 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358319 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358553 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358644 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358862 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.358955 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359169 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359254 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359476 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359567 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359780 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.359865 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360085 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360170 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360398 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360482 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360708 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.360799 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.361018 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.361101 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.361849 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.361942 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362167 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362253 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362481 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362581 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362792 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.362883 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363102 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363195 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363413 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363509 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363745 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.363839 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364052 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364134 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364362 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364446 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364688 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.364782 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365002 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365087 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365331 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365419 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365644 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365789 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.365949 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366034 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366254 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366339 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366558 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366660 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366870 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.366993 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367169 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367263 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367471 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367567 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367776 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.367860 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368078 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368161 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368380 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368467 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368683 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368779 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.368991 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369076 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369337 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369479 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369647 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369767 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.369966 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.370078 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.370277 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.370583 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.370888 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371193 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371279 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371536 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371622 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371844 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.371929 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372188 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372274 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372512 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372604 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372830 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.372913 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373143 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373266 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373483 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373569 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373794 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.373878 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374107 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374190 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374417 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374502 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374729 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.374820 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375039 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375131 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375349 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375434 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375668 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375761 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.375980 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376077 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376293 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376377 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376601 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376684 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.376920 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.377101 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.377913 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.378384 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.378900 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.378984 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379249 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379347 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379575 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379667 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379901 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.379986 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380218 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380380 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380534 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380621 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380845 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.380930 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381157 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381261 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381513 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381599 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381825 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.381920 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382146 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382239 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382458 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382543 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382771 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.382855 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383083 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383169 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383399 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383484 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383709 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.383795 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384026 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384111 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384331 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384422 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384646 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384732 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.384967 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385058 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385308 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385407 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385621 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385714 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.385933 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386018 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386256 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386341 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386566 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386664 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386875 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.386967 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387188 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387271 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387497 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387590 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387804 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.387890 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388117 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388201 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388426 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388518 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388734 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.388825 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389044 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389135 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389381 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389696 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.389779 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390003 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390086 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390306 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390392 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390611 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390695 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.390920 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391004 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391224 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391309 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391531 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391617 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391844 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.391928 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392163 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392248 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392467 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392556 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392796 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.392889 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393118 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393203 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393448 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393534 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393751 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.393852 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394063 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394148 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394366 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394450 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394671 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394763 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.394977 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395062 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395290 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395375 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395605 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395697 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.395926 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396056 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396234 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396318 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396546 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396632 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396856 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.396948 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397166 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397268 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397510 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397595 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397820 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.397907 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398129 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398214 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398440 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398527 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398750 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.398834 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399060 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399151 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399370 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399457 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399683 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399766 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.399990 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400081 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400299 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400386 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400609 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400693 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.400914 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401006 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401254 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401343 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401561 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401645 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.401871 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.402126 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.402213 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.402458 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.402551 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.402773 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403042 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403136 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403379 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403475 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403700 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.403833 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404026 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404112 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404360 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404453 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404675 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404842 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.404983 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405070 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405315 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405418 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405624 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405711 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.405931 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406018 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406243 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406338 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406547 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406632 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406852 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.406936 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407158 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407245 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407464 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407556 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407767 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.407851 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.408071 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.408157 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.408923 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409081 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409269 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409419 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409568 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409733 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.409875 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410046 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410188 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410357 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410492 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410676 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410812 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.410986 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411125 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411303 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411429 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411610 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411734 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.411937 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.412022 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.412251 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.412366 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.412558 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.412669 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413100 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413185 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413508 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413594 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413858 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.413942 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414167 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414252 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414522 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414609 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414848 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.414933 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415155 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415275 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415460 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415589 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415763 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.415902 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416072 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416239 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416381 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416550 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416683 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416859 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.416994 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417168 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417326 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417509 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417637 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417824 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.417946 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418132 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418249 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418445 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418544 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418758 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.418925 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419074 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419163 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419386 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419472 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419692 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.419790 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420006 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420090 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420316 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420401 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420625 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420719 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.420928 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421026 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421271 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421360 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421649 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421865 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.421948 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422166 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422251 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422470 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422557 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422774 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.422859 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.423078 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.423161 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.423648 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.423740 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.424009 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.424635 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.424832 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.424916 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425143 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425248 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425486 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425571 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425793 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.425886 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426102 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426195 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426405 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426490 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426710 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.426803 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427020 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427105 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427328 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427420 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427645 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427745 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.427946 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428038 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428252 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428337 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428555 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428651 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428859 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.428945 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429163 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429286 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429505 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429604 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429809 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.429894 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430112 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430198 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430415 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430509 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430718 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.430802 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431104 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431324 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431410 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431630 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431714 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.431934 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432025 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432238 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432324 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432537 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432622 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432862 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.432946 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433170 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433336 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433506 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433590 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433816 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.433913 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434121 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434213 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434454 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434537 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434760 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.434938 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435069 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435157 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435379 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435471 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435682 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435776 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.435998 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436083 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436310 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436408 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436620 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436719 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.436923 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437339 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437535 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437637 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437857 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.437945 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438165 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438251 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438481 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438585 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438789 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.438874 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439097 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439181 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439397 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439495 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439731 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.439816 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440038 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440123 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440348 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440447 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440657 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440743 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.440966 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441298 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441400 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441612 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441696 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.441919 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442003 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442227 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442314 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442536 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442634 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442840 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.442932 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443146 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443233 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443456 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443542 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443764 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.443848 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444073 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444158 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444381 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444472 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444685 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444771 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.444993 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445079 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445318 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445407 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445628 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445725 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.445931 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446015 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446256 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446340 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446564 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446664 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446879 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.446964 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447185 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447270 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447496 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447591 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447802 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.447887 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448128 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448211 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448439 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448526 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448742 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.448828 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449119 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449202 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449458 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449548 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449773 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.449859 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450079 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450162 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450383 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450476 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450685 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450779 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.450991 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451108 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451314 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451424 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451619 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451736 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.451925 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452049 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452227 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452356 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452546 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452643 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452850 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.452945 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453167 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453286 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453587 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453674 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453896 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.453996 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454204 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454329 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454528 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454612 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454834 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.454938 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455180 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455265 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455537 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455620 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455857 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.455943 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456180 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456289 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456485 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456606 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456798 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.456922 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457108 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457252 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457455 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457582 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457778 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.457909 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458091 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458222 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458404 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458529 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458708 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.458846 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459027 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459158 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459347 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459482 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459657 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459809 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.459976 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.460127 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.460385 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.460477 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.460705 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.460800 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461014 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461108 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461443 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461677 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461776 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.461981 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462284 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462411 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462595 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462737 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.462898 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463050 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463203 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463373 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463522 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463698 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.463830 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464004 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464140 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464311 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464444 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464625 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464745 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.464931 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465048 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465322 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465431 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465654 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465740 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.465962 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466048 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466280 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466375 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466594 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466680 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.466905 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467000 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467213 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467311 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467566 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467663 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467833 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.467918 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468135 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468229 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468435 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468520 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468737 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.468822 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469038 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469125 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469399 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469497 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469704 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.469790 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.470023 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.470110 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.470333 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.470417 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.470641 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.471232 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.471483 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.471570 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.471790 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.471875 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472124 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472219 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472431 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472515 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472740 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.472824 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473055 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473149 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473402 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473490 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473707 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.473803 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474009 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474322 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474416 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474624 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474720 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.474925 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475056 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475225 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475357 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475532 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475619 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475832 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.475920 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476130 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476216 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476429 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476514 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476748 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.476835 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477048 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477140 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477374 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477472 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477686 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477772 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.477991 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478082 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478291 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478386 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478592 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478687 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.478913 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479005 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479220 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479314 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479543 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479629 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479851 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.479936 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480156 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480251 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480460 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480547 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480763 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.480848 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481073 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481166 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481412 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481544 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481726 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.481812 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482038 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482201 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482353 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482440 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482661 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482747 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.482976 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483066 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483302 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483410 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483604 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483701 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.483922 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484116 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484239 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484454 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484539 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484771 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.484869 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485087 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485174 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485437 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485539 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485752 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.485847 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.486065 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.486299 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.486973 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487189 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487289 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487512 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487600 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487830 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.487914 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488146 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488244 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488465 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488550 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488780 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.488864 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489098 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489194 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489439 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489526 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489753 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.489849 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490066 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490160 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490379 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490464 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490705 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.490799 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491125 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491339 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491425 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491654 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491749 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.491971 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492065 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492285 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492370 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492597 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492695 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492907 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.492993 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493244 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493333 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493561 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493660 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493872 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.493966 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494182 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494276 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494498 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494584 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494809 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.494893 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495121 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495219 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495440 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495527 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495757 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.495843 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496072 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496195 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496385 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496477 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496698 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.496782 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497011 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497212 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497361 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497567 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497700 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.497900 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498026 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498225 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498345 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498549 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498666 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498864 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.498986 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.499181 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.499504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.499597 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.499811 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.499911 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500117 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500204 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500428 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500515 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500738 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.500831 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501042 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501129 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501391 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501482 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501705 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.501803 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502045 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502135 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502356 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502441 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502672 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502757 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.502987 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503206 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503292 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503550 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503644 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503866 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.503960 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504193 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504278 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504515 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504600 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504830 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.504917 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.505138 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.505387 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.505475 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.505735 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.505833 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506055 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506141 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506374 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506466 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506686 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506780 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.506990 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507083 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507293 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507386 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507605 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507693 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507912 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.507997 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508213 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508297 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508524 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508620 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508829 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.508915 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509132 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509216 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509464 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509553 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509772 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.509856 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510076 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510168 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510380 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510472 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510683 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510767 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.510986 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511082 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511289 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511381 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511593 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511679 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511904 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.511996 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512205 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512297 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512514 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512601 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512818 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.512913 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513123 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513206 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513458 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513552 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513767 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.513867 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514080 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514165 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514411 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514515 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514698 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.514785 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515000 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515094 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515312 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515398 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515621 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515707 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.515940 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516026 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516250 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516342 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516559 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516646 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516867 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.516952 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.517174 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.517277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.517518 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.517773 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.517861 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518108 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518193 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518429 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518763 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.518859 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.519085 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.519170 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.519394 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.519488 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.519710 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520018 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520112 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520344 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520440 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520656 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520749 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.520968 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521061 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521302 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521405 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521616 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521709 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.521926 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522055 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522236 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522322 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522542 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522625 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522852 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.522938 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523161 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523256 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523470 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523555 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523778 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.523864 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524088 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524176 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524401 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524485 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524708 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.524800 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525021 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525113 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525363 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525453 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525676 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525775 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.525987 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526073 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526300 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526384 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526610 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526703 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.526915 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527000 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527224 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527318 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527532 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527618 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527837 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.527921 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528150 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528236 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528476 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528564 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528786 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.528878 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.529089 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.529175 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.529426 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.529737 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.529830 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530071 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530171 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530365 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530461 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530681 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530765 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.530992 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.531077 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.531298 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.531392 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.531620 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.531928 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532054 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532246 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532342 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532556 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532650 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532878 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.532963 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.533745 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.533844 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534075 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534162 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534394 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534487 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534699 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.534788 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535007 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535094 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535311 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535403 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535620 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535707 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.535936 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536020 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536242 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536335 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536543 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536630 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536842 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.536926 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537150 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537264 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537479 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537565 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537782 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.537867 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538084 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538362 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538457 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538679 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538764 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.538978 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539064 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539280 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539365 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539578 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539662 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539880 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.539975 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540180 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540274 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540479 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540564 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540780 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.540873 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541077 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541162 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541403 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541491 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541752 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.541853 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542006 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542093 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542307 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542432 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542610 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542708 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.542916 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543003 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543226 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543319 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543530 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543617 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543834 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.543928 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544140 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544226 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544445 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544539 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544751 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.544836 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545078 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545162 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545418 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545552 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545729 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.545818 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546049 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546133 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546357 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546442 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546666 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546759 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.546978 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547072 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547288 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547374 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547595 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547680 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547906 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.547999 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.548221 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.548573 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.548805 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549041 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549172 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549291 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549510 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549596 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549824 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.549908 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550134 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550228 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550447 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550532 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550758 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.550842 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551082 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551169 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551392 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551477 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551699 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.551784 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552007 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552093 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552313 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552398 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552621 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552708 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.552933 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553020 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553258 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553347 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553571 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553671 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553883 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.553969 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554193 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554505 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554606 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554816 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.554903 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555127 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555211 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555442 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555536 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555753 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.555838 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556063 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556148 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556380 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556467 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556700 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.556786 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557025 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557112 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557432 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557579 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557776 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.557975 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.558173 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.558336 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.558552 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.558657 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.558845 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:48:34.559082 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.559716 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.560201 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.560525 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.560849 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.561162 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:48:34.561435 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:48:34.712124 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO dbcounter [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Registered counter for database nova_api Sep 26 17:48:34.715271 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO dbcounter [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Registered counter for database nova_api Sep 26 17:48:34.732385 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_db.sqlalchemy.engines [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.737074 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_db.sqlalchemy.engines [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.739732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writer thread running {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.744217 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writer thread running {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.795740 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.context [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6eded39c-877a-426d-8a1f-1043d953fe22(cell1) {{(pid=117517) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:48:34.800303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:48:34.800772 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:48:34.801092 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.context [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6eded39c-877a-426d-8a1f-1043d953fe22(cell1) {{(pid=117518) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:48:34.802346 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:48:34.803062 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:48:34.803502 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:48:34.804977 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:48:34.805480 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:48:34.805586 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:48:34.807024 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:48:34.807434 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO dbcounter [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Registered counter for database nova_cell0 Sep 26 17:48:34.807744 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:48:34.808189 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:48:34.810184 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_concurrency.lockutils [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:48:34.811479 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO dbcounter [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Registered counter for database nova_cell1 Sep 26 17:48:34.812156 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO dbcounter [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Registered counter for database nova_cell0 Sep 26 17:48:34.816684 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO dbcounter [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Registered counter for database nova_cell1 Sep 26 17:48:34.820283 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_db.sqlalchemy.engines [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.822112 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_db.sqlalchemy.engines [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.824148 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_db.sqlalchemy.engines [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.825794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_db.sqlalchemy.engines [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.826333 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writer thread running {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.831369 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writer thread running {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.832130 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writer thread running {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.834180 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writer thread running {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.973309 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO dbcounter [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Registered counter for database nova_cell0 Sep 26 17:48:34.979760 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO dbcounter [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Registered counter for database nova_cell0 Sep 26 17:48:34.982178 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_db.sqlalchemy.engines [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.987627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writer thread running {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:34.988982 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG oslo_db.sqlalchemy.engines [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:48:34.993819 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writer thread running {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:48:35.400550 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: WARNING keystonemiddleware.auth_token [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:48:35.407778 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: WARNING keystonemiddleware.auth_token [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:48:35.422105 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: WARNING keystonemiddleware.auth_token [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:48:35.430133 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: WARNING keystonemiddleware.auth_token [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:48:35.749065 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: WARNING keystonemiddleware.auth_token [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:48:35.755490 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: WARNING keystonemiddleware.auth_token [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:48:35.761064 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa72fd39c0 pid: 117517 (default app) Sep 26 17:48:35.763178 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:48:35.764365 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Sep 26 17:48:35.764775 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Sep 26 17:48:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:48:35.766993 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: WARNING keystonemiddleware.auth_token [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:48:35.773481 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: WARNING keystonemiddleware.auth_token [None req-15474762-5f1c-4d85-89e2-117fae6f19f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:48:35.778693 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa72fd39c0 pid: 117518 (default app) Sep 26 17:49:59.475947 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:49:59.477871 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Sep 26 17:49:59.478255 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:49:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:49:59.495387 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_api:SELECT=3 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:59.496367 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_cell1:SELECT=3 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:59.497288 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_cell0:SELECT=3 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:59.499745 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:00.428970 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-a8a17ba7-c856-49c1-bc4c-854a94b34863 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:00.460803 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-a8a17ba7-c856-49c1-bc4c-854a94b34863 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.973032 Sep 26 17:50:00.461568 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 17:49:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:03.074863 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:03.074863 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f11e977d-422d-4491-83c9-4e64dd0f7eb2 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 26 17:50:03.079963 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:03.540606 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-574d1776-acb9-4b84-ae4c-aa4985183ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:03.648652 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-574d1776-acb9-4b84-ae4c-aa4985183ef1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.566898 Sep 26 17:50:03.649432 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:03.663028 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_api:SELECT=3 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:03.664225 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_cell0:SELECT=3 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:03.666256 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_cell1:SELECT=3 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:03.667337 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:03.869951 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-715bcd23-fd35-4f5e-a88e-3cfd9cbd64ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:04.006575 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-715bcd23-fd35-4f5e-a88e-3cfd9cbd64ac admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348579 Sep 26 17:50:04.007099 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 17:50:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:06.590154 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-574d1776-acb9-4b84-ae4c-aa4985183ef1 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:06.591173 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-574d1776-acb9-4b84-ae4c-aa4985183ef1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 26 17:50:06.591883 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:50:07.266125 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-05567390-201f-4060-9d31-0d3411728007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:07.366410 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-05567390-201f-4060-9d31-0d3411728007 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.768170 Sep 26 17:50:07.366975 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:50:07.380284 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-359ca82b-5a94-41c3-afbb-646dc86fbeba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:07.505427 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-359ca82b-5a94-41c3-afbb-646dc86fbeba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128745 Sep 26 17:50:07.506149 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 17:50:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:50:10.104977 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-05567390-201f-4060-9d31-0d3411728007 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:10.106039 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-05567390-201f-4060-9d31-0d3411728007 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 26 17:50:10.106453 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:10.528191 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-48a8f8b9-93c9-4508-837d-8b121c36f003 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "ram": 1024, "vcpus": 1}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:10.604454 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-48a8f8b9-93c9-4508-837d-8b121c36f003 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491199 Sep 26 17:50:10.605021 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:10.617372 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-c8b58673-cfbe-420d-9d95-5f8f1407c47f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:10.700790 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-c8b58673-cfbe-420d-9d95-5f8f1407c47f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087155 Sep 26 17:50:10.701953 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 17:50:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:13.297034 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-48a8f8b9-93c9-4508-837d-8b121c36f003 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:13.298080 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-48a8f8b9-93c9-4508-837d-8b121c36f003 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 26 17:50:13.298486 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:13.721037 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-855303f7-b87f-4456-8538-76f9e0e939fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:13.809905 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-855303f7-b87f-4456-8538-76f9e0e939fc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505323 Sep 26 17:50:13.813371 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:13.824196 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-8c7821b3-690a-4e39-a81d-29ae4ce05418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:13.890088 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-8c7821b3-690a-4e39-a81d-29ae4ce05418 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071072 Sep 26 17:50:13.894886 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 17:50:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:16.494613 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-855303f7-b87f-4456-8538-76f9e0e939fc admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:16.495632 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-855303f7-b87f-4456-8538-76f9e0e939fc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 26 17:50:16.496031 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:16.966050 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:17.067339 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565163 Sep 26 17:50:17.067924 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:50:17.080736 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-5c2d1b4d-05c2-4f8e-96d0-c6b24fa0a22c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:17.156257 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-5c2d1b4d-05c2-4f8e-96d0-c6b24fa0a22c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079342 Sep 26 17:50:17.156871 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 17:50:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:20.306908 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:20.308127 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Sep 26 17:50:20.308694 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:20.725395 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-766d5c41-44f0-42c7-b131-ab9841103705 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:20.749714 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-766d5c41-44f0-42c7-b131-ab9841103705 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433769 Sep 26 17:50:20.750378 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 17:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:23.329640 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:23.330578 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-f04b5b77-591c-43ce-bd61-e2c02b66732b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 26 17:50:23.330988 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:23.776749 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-6b6a9ad6-9af0-46ea-811e-1d0b275f5b92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 512, "id": "1"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:23.833192 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-6b6a9ad6-9af0-46ea-811e-1d0b275f5b92 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.496222 Sep 26 17:50:23.833793 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:50:23.845739 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4fa18eca-1ef3-4d68-8bea-dfffa9a2f7e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:23.923069 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4fa18eca-1ef3-4d68-8bea-dfffa9a2f7e2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080978 Sep 26 17:50:23.923577 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 17:50:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:26.522959 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-6b6a9ad6-9af0-46ea-811e-1d0b275f5b92 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:26.523964 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-6b6a9ad6-9af0-46ea-811e-1d0b275f5b92 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 26 17:50:26.524395 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:26.902120 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-10c96baf-a848-434f-acd2-48b55bcba5ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:26.985102 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-10c96baf-a848-434f-acd2-48b55bcba5ba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454079 Sep 26 17:50:26.985865 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:26.999713 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-db24bc70-b718-445f-b8b7-e68e70d239c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:27.082278 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-db24bc70-b718-445f-b8b7-e68e70d239c3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086578 Sep 26 17:50:27.083064 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 17:50:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:29.736901 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-10c96baf-a848-434f-acd2-48b55bcba5ba admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:29.737957 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-10c96baf-a848-434f-acd2-48b55bcba5ba admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 26 17:50:29.738353 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:50:30.211125 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-1509b566-fc76-4f95-b652-85b58893bfc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:30.309088 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-1509b566-fc76-4f95-b652-85b58893bfc6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.560943 Sep 26 17:50:30.309764 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:30.323042 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-3ce4c47e-d77d-4d8b-a6de-ed98cafb7fb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:30.329179 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:30.424540 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-3ce4c47e-d77d-4d8b-a6de-ed98cafb7fb7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106337 Sep 26 17:50:30.425245 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 17:50:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:33.040875 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-1509b566-fc76-4f95-b652-85b58893bfc6 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:33.041929 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-1509b566-fc76-4f95-b652-85b58893bfc6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 26 17:50:33.042518 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:50:33.492674 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-c3403fa3-a02a-4e26-85ca-e0bfb750133f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4, "name": "m1.large"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:33.761277 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-c3403fa3-a02a-4e26-85ca-e0bfb750133f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.707150 Sep 26 17:50:33.766048 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:50:33.771778 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f8049f50-4123-4091-b847-962f1dfe6616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:33.865554 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f8049f50-4123-4091-b847-962f1dfe6616 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098530 Sep 26 17:50:33.866560 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 17:50:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:50:36.519367 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-c3403fa3-a02a-4e26-85ca-e0bfb750133f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:36.521153 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-c3403fa3-a02a-4e26-85ca-e0bfb750133f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Sep 26 17:50:36.522317 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:36.966994 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:36.973464 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:37.026499 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497535 Sep 26 17:50:37.027444 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 17:50:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:50:37.040345 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-fd998ea2-6d41-4d2e-b95e-a11fe5d3a2e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:50:37.150914 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-fd998ea2-6d41-4d2e-b95e-a11fe5d3a2e9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114235 Sep 26 17:50:37.151578 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 17:50:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:50:53.889149 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:53.890201 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 26 17:50:53.890635 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:50:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:53.901151 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:54.282058 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30dfd1f7-3eef-4d3f-8ce8-5d966e06b457 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:54.300233 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30dfd1f7-3eef-4d3f-8ce8-5d966e06b457 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403478 Sep 26 17:50:54.300763 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 17:50:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:55.619850 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:55.620882 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-394e4c88-e9a2-41cd-aa7e-72506c29121f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 26 17:50:55.621826 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:56.145384 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-aca22cd8-a830-409f-b075-3512896e1a5c admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:56.150655 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.wsgi [None req-aca22cd8-a830-409f-b075-3512896e1a5c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-aca22cd8-a830-409f-b075-3512896e1a5c admin admin] Request method failure captured: Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept: application/json Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept-Encoding: gzip, deflate Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Connection: keep-alive Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Content-Length: 0 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Host: 10.222.0.49 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-System-Scope: None Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: User-Agent: python-novaclient Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Auth-Token: gAAAAABjMeZ_ys1zMRnctNwLyunxklmRB3M2HHZc1aPZ8jPY25N41FVUVYkSgIdnRGiWJfAjr7fgQ8SciF-bCbQNUzL3QniiYPXB1RTDo8CXHpcOhQMKehO9C_uAPRStNNqUH85yZbsSmGCVzfXvtpP8owdjY0RfgNq2TV6GwpCDKaPu7XHDj5s Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Id: None Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Name: None Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Identity-Status: Confirmed Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Is-Admin-Project: True Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Id: default Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Name: Default Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Name: admin Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Role: reader,admin,member Sep 26 17:50:56.154468 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Roles: reader,admin,member Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant: admin Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Name: admin Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User: admin Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Id: default Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Name: Default Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Name: admin Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: method: > Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: exception: Flavor 42 could not be found. Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: action_args: {'id': '42'} Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:56.156200 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:56.157301 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.158562 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-aca22cd8-a830-409f-b075-3512896e1a5c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:56.159629 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-aca22cd8-a830-409f-b075-3512896e1a5c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394953 Sep 26 17:50:56.159629 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 17:50:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:56.165985 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-b69aa7ef-d13a-4630-b61c-7170d0ee17b9 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:56.188854 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-b69aa7ef-d13a-4630-b61c-7170d0ee17b9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026716 Sep 26 17:50:56.189428 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:56.200356 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-b27ce823-d915-4ffa-92f2-8286f99ae947 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:56.222309 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-b27ce823-d915-4ffa-92f2-8286f99ae947 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026557 Sep 26 17:50:56.222790 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:56.232961 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-3f6ef939-e559-4934-9cc6-efa2de3b6d95 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:56.238747 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.wsgi [None req-3f6ef939-e559-4934-9cc6-efa2de3b6d95 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-3f6ef939-e559-4934-9cc6-efa2de3b6d95 admin admin] Request method failure captured: Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept: application/json Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept-Encoding: gzip, deflate Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Connection: keep-alive Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Content-Length: 0 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Host: 10.222.0.49 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-System-Scope: None Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: User-Agent: python-novaclient Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Auth-Token: gAAAAABjMeZ_ys1zMRnctNwLyunxklmRB3M2HHZc1aPZ8jPY25N41FVUVYkSgIdnRGiWJfAjr7fgQ8SciF-bCbQNUzL3QniiYPXB1RTDo8CXHpcOhQMKehO9C_uAPRStNNqUH85yZbsSmGCVzfXvtpP8owdjY0RfgNq2TV6GwpCDKaPu7XHDj5s Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Id: None Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Name: None Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Identity-Status: Confirmed Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Is-Admin-Project: True Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Id: default Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Name: Default Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Name: admin Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Role: reader,admin,member Sep 26 17:50:56.242019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Roles: reader,admin,member Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant: admin Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Name: admin Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User: admin Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Id: default Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Name: Default Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Name: admin Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: method: > Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: exception: Flavor 42 could not be found. Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: action_args: {'id': '42'} Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:56.247035 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:56.248017 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:56.249354 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-3f6ef939-e559-4934-9cc6-efa2de3b6d95 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:56.250675 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-3f6ef939-e559-4934-9cc6-efa2de3b6d95 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014915 Sep 26 17:50:56.250675 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 17:50:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:57.460765 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-b27ce823-d915-4ffa-92f2-8286f99ae947 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:57.461806 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-b27ce823-d915-4ffa-92f2-8286f99ae947 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 26 17:50:57.462198 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:57.990406 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4b99016f-5b1d-40e8-a55e-f85dc16e884c admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:57.995488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.wsgi [None req-4b99016f-5b1d-40e8-a55e-f85dc16e884c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4b99016f-5b1d-40e8-a55e-f85dc16e884c admin admin] Request method failure captured: Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept: application/json Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept-Encoding: gzip, deflate Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Connection: keep-alive Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Content-Length: 0 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Host: 10.222.0.49 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-System-Scope: None Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: User-Agent: python-novaclient Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Auth-Token: gAAAAABjMeaBNtj26_h6IIbDSVqo2UPZ5KsUhBJ4ap_YvcDzlWzOrSZkdQN9ThrWAcGCdaF6CciY7jPbVoV5R43Tr9JfmbxxzaK-mpPVUkPVI-__zKPl2YF_M3DlnB5syWWqGeHs5rOY9MThg_XHxVqLaPmfVnTbogSPxFtPJJSRb5Hcf7dW0JY Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Id: None Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Name: None Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Identity-Status: Confirmed Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Is-Admin-Project: True Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Id: default Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Name: Default Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Name: admin Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Role: reader,admin,member Sep 26 17:50:57.997032 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Roles: reader,admin,member Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant: admin Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Name: admin Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User: admin Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Id: default Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Name: Default Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Name: admin Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: method: > Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: exception: Flavor 84 could not be found. Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: action_args: {'id': '84'} Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:57.998551 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:57.999488 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.000732 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4b99016f-5b1d-40e8-a55e-f85dc16e884c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:58.002055 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-4b99016f-5b1d-40e8-a55e-f85dc16e884c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399394 Sep 26 17:50:58.002055 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 17:50:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:58.008456 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-82626718-4668-4df4-95d7-41accb303904 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:58.023857 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-82626718-4668-4df4-95d7-41accb303904 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019117 Sep 26 17:50:58.024385 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:58.034381 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4d205775-7a16-4683-9d28-8bad786ea360 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:58.050892 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-4d205775-7a16-4683-9d28-8bad786ea360 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019974 Sep 26 17:50:58.051448 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:58.061078 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-ce58dc51-529f-4bfb-b564-cc9914e88fd1 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:58.066302 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.wsgi [None req-ce58dc51-529f-4bfb-b564-cc9914e88fd1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-ce58dc51-529f-4bfb-b564-cc9914e88fd1 admin admin] Request method failure captured: Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept: application/json Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept-Encoding: gzip, deflate Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Connection: keep-alive Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Content-Length: 0 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Host: 10.222.0.49 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-System-Scope: None Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: User-Agent: python-novaclient Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Auth-Token: gAAAAABjMeaBNtj26_h6IIbDSVqo2UPZ5KsUhBJ4ap_YvcDzlWzOrSZkdQN9ThrWAcGCdaF6CciY7jPbVoV5R43Tr9JfmbxxzaK-mpPVUkPVI-__zKPl2YF_M3DlnB5syWWqGeHs5rOY9MThg_XHxVqLaPmfVnTbogSPxFtPJJSRb5Hcf7dW0JY Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Id: None Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Name: None Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Identity-Status: Confirmed Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Is-Admin-Project: True Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Id: default Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Name: Default Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Name: admin Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Role: reader,admin,member Sep 26 17:50:58.067794 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Roles: reader,admin,member Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant: admin Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Name: admin Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User: admin Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Id: default Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Name: Default Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Name: admin Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: method: > Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: exception: Flavor 84 could not be found. Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: action_args: {'id': '84'} Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:58.069103 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:58.069935 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:58.071270 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-ce58dc51-529f-4bfb-b564-cc9914e88fd1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:58.072544 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-ce58dc51-529f-4bfb-b564-cc9914e88fd1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011700 Sep 26 17:50:58.073187 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 17:50:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:59.296063 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4d205775-7a16-4683-9d28-8bad786ea360 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:59.297097 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-4d205775-7a16-4683-9d28-8bad786ea360 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 26 17:50:59.297537 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:50:59.825085 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-025a67ee-6691-4bbd-996f-a22907ab799b admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:59.830949 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.wsgi [None req-025a67ee-6691-4bbd-996f-a22907ab799b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-025a67ee-6691-4bbd-996f-a22907ab799b admin admin] Request method failure captured: Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept: application/json Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Accept-Encoding: gzip, deflate Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Connection: keep-alive Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Content-Length: 0 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Host: 10.222.0.49 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Openstack-System-Scope: None Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: User-Agent: python-novaclient Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Auth-Token: gAAAAABjMeaDCmVjTuGCy5BHoJHwrRBxp6j7_X46OqftpqaFfemkkvmRYSKVFvGzLVB-Z664p6ghuZIqxqAhr2WAT9LA5W5EwRAN43P0yHrKpze9ILlOmQu9re9av2Mva2wMlnxw2z5X6UNuyfolxrvuLN5aD85S0x2R2-0KJoa4SyibGaoOEqw Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Id: None Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Domain-Name: None Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Identity-Status: Confirmed Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Is-Admin-Project: True Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Id: default Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Domain-Name: Default Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Project-Name: admin Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Role: reader,admin,member Sep 26 17:50:59.832446 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Roles: reader,admin,member Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant: admin Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-Tenant-Name: admin Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User: admin Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Id: default Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Domain-Name: Default Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: X-User-Name: admin Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: method: > Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: exception: Flavor 451 could not be found. Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: action_args: {'id': '451'} Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:59.834067 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:59.834953 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.836584 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-025a67ee-6691-4bbd-996f-a22907ab799b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:59.838341 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-025a67ee-6691-4bbd-996f-a22907ab799b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396840 Sep 26 17:50:59.838341 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:50:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:59.845728 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-aa23a5bc-9a44-482c-bad0-e1e38e7e7c6a admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:59.860526 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-aa23a5bc-9a44-482c-bad0-e1e38e7e7c6a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018395 Sep 26 17:50:59.861073 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:59.870377 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:59.885414 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018504 Sep 26 17:50:59.885954 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 17:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:50:59.895301 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-e5838595-818d-4e45-8cf3-04cf2430ae8d admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:50:59.900130 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.wsgi [None req-e5838595-818d-4e45-8cf3-04cf2430ae8d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-e5838595-818d-4e45-8cf3-04cf2430ae8d admin admin] Request method failure captured: Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept: application/json Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Accept-Encoding: gzip, deflate Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Connection: keep-alive Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Content-Length: 0 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Host: 10.222.0.49 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-Api-Version: compute 2.92 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Openstack-System-Scope: None Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: User-Agent: python-novaclient Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Auth-Token: gAAAAABjMeaDCmVjTuGCy5BHoJHwrRBxp6j7_X46OqftpqaFfemkkvmRYSKVFvGzLVB-Z664p6ghuZIqxqAhr2WAT9LA5W5EwRAN43P0yHrKpze9ILlOmQu9re9av2Mva2wMlnxw2z5X6UNuyfolxrvuLN5aD85S0x2R2-0KJoa4SyibGaoOEqw Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Id: None Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Domain-Name: None Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Identity-Status: Confirmed Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Is-Admin-Project: True Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Id: default Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Domain-Name: Default Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Project-Name: admin Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Role: reader,admin,member Sep 26 17:50:59.901627 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Roles: reader,admin,member Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f09075fdb6504d32a3cf3210669ac824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f09075fdb6504d32a3cf3210669ac824"}]}] Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant: admin Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Id: f09075fdb6504d32a3cf3210669ac824 Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-Tenant-Name: admin Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User: admin Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Id: default Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Domain-Name: Default Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Id: fd526728926248e18cc8e626ea1d69da Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: X-User-Name: admin Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: method: > Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: exception: Flavor 451 could not be found. Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: action_args: {'id': '451'} Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:50:59.903303 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:59.904277 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: ERROR nova.api.openstack.wsgi Sep 26 17:50:59.905504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-e5838595-818d-4e45-8cf3-04cf2430ae8d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:50:59.906597 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-e5838595-818d-4e45-8cf3-04cf2430ae8d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011099 Sep 26 17:50:59.906597 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:50:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:51:01.123430 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:01.124434 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 26 17:51:01.124836 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:51:01.649101 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-d05d9b60-bafb-42bd-9346-5400d85f5e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:51:01.717612 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-d05d9b60-bafb-42bd-9346-5400d85f5e58 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.453426 Sep 26 17:51:01.722306 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 17:51:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:51:02.933810 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:02.934825 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 26 17:51:02.935223 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:51:03.457927 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-dce75d90-dbc5-43f1-80da-d3d84a5cc16b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:51:03.534293 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-dce75d90-dbc5-43f1-80da-d3d84a5cc16b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.459867 Sep 26 17:51:03.534773 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 17:51:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:51:04.763342 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:04.764355 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 26 17:51:04.764763 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:51:05.287019 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-e3abf115-034c-4252-900d-0ceae8ecee90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:51:05.380291 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-e3abf115-034c-4252-900d-0ceae8ecee90 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.474589 Sep 26 17:51:05.380835 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 17:51:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:51:06.596299 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:06.597358 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 26 17:51:06.597747 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:51:07.119680 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-4d458a7f-3e17-4dbd-ae18-a5a6f1849b30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:51:07.196709 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-4d458a7f-3e17-4dbd-ae18-a5a6f1849b30 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.459495 Sep 26 17:51:07.197186 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 17:51:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:51:08.425061 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:08.426106 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 26 17:51:08.426501 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:51:08.949148 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-b0f8e140-8d19-425a-9c4f-c7c954a5e492 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:51:08.969556 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-b0f8e140-8d19-425a-9c4f-c7c954a5e492 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406048 Sep 26 17:51:08.970095 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Sep 26 17:51:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:52:05.923194 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:05.924240 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-4d3a2d49-25fc-4a5d-b4da-6c429b5279a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 26 17:52:05.924856 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 17:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:52:05.935437 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:52:06.317636 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-51eecc71-37a2-43d3-9693-36756a94ec20 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:06.337835 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-51eecc71-37a2-43d3-9693-36756a94ec20 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406751 Sep 26 17:52:06.338311 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 17:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:52:06.359420 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_api:SELECT=14 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:52:06.363104 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-7d47ec3f-7674-4778-a7aa-53c5e72aed76 admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:06.370842 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-7d47ec3f-7674-4778-a7aa-53c5e72aed76 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012940 Sep 26 17:52:06.371359 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 17:52:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:52:06.382924 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-d6c00dde-0827-406a-8eb4-572e25166ac9 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:06.390115 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-d6c00dde-0827-406a-8eb4-572e25166ac9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010799 Sep 26 17:52:06.390629 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 17:52:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:52:06.401828 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:06.409738 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011420 Sep 26 17:52:06.410259 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 17:52:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:52:06.422140 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f71d22e1-718c-44bb-b24d-2f2ef5461b6f admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:52:06.429140 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f71d22e1-718c-44bb-b24d-2f2ef5461b6f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010422 Sep 26 17:52:06.429691 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 17:52:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:18.803480 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:18.804520 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 26 17:55:18.804914 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:18.946235 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_api:SELECT=6 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:19.113395 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:19.118095 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:19.118570 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:19.119004 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:19.119719 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:19.120165 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:19.120584 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:19.153011 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-cc81f8ea-3429-47f6-9d33-477b374fd5f3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.207907 Sep 26 17:55:19.153769 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:55:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:20.233621 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:20.234625 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 26 17:55:20.235020 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:20.431511 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:20.434915 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:20.436045 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:20.436469 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:20.437189 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:20.437958 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:20.438381 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:20.458483 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-02bdc6ae-c3aa-44e1-848f-262fde67f686 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080524 Sep 26 17:55:20.458968 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:55:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:31.946875 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:31.947878 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 26 17:55:31.948267 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:32.092146 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_cell0:SELECT=4 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:32.092864 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_cell1:SELECT=4 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:32.093504 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG dbcounter [-] [117517] Writing DB stats nova_api:SELECT=8 {{(pid=117517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:32.143049 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:32.146578 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:32.147099 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:32.147523 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:32.148234 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:32.148678 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:32.149093 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:32.175412 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-f8055782-81bf-4e00-b4f6-f37cd64ed905 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087658 Sep 26 17:55:32.176001 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:55:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:55:33.248350 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG nova.api.openstack.wsgi [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] Calling method '>' {{(pid=117518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:33.249417 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: INFO nova.api.openstack.requestlog [None req-30cb7536-8e89-4a93-8ded-3b40a524345f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Sep 26 17:55:33.249810 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: [pid: 117518|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 17:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:33.450278 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG nova.api.openstack.wsgi [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Calling method '>' {{(pid=117517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:33.453702 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:33.454173 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:33.454594 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:33.455360 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:55:33.455745 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:55:33.456157 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: DEBUG oslo_concurrency.lockutils [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:55:33.477965 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: INFO nova.api.openstack.requestlog [None req-6185da7b-b234-4520-9ab2-3ebec45f2938 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080564 Sep 26 17:55:33.478541 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: [pid: 117517|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 17:55:33 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:30.630684 dv-cinder-859317-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 17:56:30.631218 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: Mon Sep 26 17:56:30 2022 - graceful shutdown triggered... Sep 26 17:56:30.631663 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: Gracefully killing worker 2 (pid: 117518)... Sep 26 17:56:30.632015 dv-cinder-859317-1-iscsi devstack@n-api.service[117517]: Gracefully killing worker 1 (pid: 117517)... Sep 26 17:56:30.758129 dv-cinder-859317-1-iscsi devstack@n-api.service[117518]: DEBUG dbcounter [-] [117518] Writing DB stats nova_api:SELECT=4 {{(pid=117518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:31.632141 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: worker 1 buried after 1 seconds Sep 26 17:56:31.632141 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: worker 2 buried after 1 seconds Sep 26 17:56:31.632141 dv-cinder-859317-1-iscsi devstack@n-api.service[117516]: goodbye to uWSGI. Sep 26 17:56:31.633722 dv-cinder-859317-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 17:56:31.634275 dv-cinder-859317-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 17:56:31.637019 dv-cinder-859317-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 17:56:31.647965 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 17:56:31 2022] *** Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: nodename: dv-cinder-859317-1-iscsi Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: machine: x86_64 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: clock source: unix Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: pcre jit disabled Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: detected number of CPU cores: 4 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: current working directory: / Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: detected binary path: /usr/bin/uwsgi-core Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: your processes number limit is 47680 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: your memory page size is 4096 bytes Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: detected max file descriptor number: 2048 Sep 26 17:56:31.650238 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: lock engine: pthread robust mutexes Sep 26 17:56:31.651273 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: thunder lock: enabled Sep 26 17:56:31.651273 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 17:56:31.651273 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 17:56:31.691287 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: Python main interpreter initialized at 0x5561fbce69c0 Sep 26 17:56:31.691287 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: python threads support enabled Sep 26 17:56:31.691287 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: your server socket listen backlog is limited to 100 connections Sep 26 17:56:31.691287 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: your mercy for graceful operations on workers is 90 seconds Sep 26 17:56:31.691740 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 17:56:31.691740 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: *** Operational MODE: preforking *** Sep 26 17:56:31.692359 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: *** uWSGI is running in multiple interpreter mode *** Sep 26 17:56:31.692359 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: spawned uWSGI master process (pid: 132935) Sep 26 17:56:31.692557 dv-cinder-859317-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 17:56:31.695984 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: spawned uWSGI worker 1 (pid: 132948, cores: 1) Sep 26 17:56:31.695984 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: spawned uWSGI worker 2 (pid: 132949, cores: 1) Sep 26 17:56:31.695984 dv-cinder-859317-1-iscsi devstack@n-api.service[132935]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 17:56:32.367679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:56:32.371981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:56:33.527082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:56:33.527082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: from cryptography.utils import int_from_bytes Sep 26 17:56:33.527747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:56:33.527747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: from cryptography.utils import int_from_bytes Sep 26 17:56:33.554824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:56:33.554824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: from cryptography.utils import int_from_bytes Sep 26 17:56:33.555381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:56:33.555381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: from cryptography.utils import int_from_bytes Sep 26 17:56:35.954201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:56:35.954828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:56:35.955004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:56:35.955367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:56:35.955627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:56:35.956016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.956341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.956729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.957108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.957450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.957768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.958130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.958586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.958925 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.959188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.959508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.960006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859317-1-iscsi {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.960332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.960643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.960957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.961308 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.961619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.961945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.962252 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.962763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.964757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.965215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.965548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.965928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.966241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.966706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859317-1-iscsi {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.967031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.967345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.967662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.968144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.968476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.968816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.969137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.969543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.969857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.970187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.970620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.970946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.971270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.971574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.971885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.972198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.972519 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.972825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.973131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.973408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.973749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.974073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.974402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.974735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.974988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.975237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.975553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.975872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.976183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.976488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.976796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.977106 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.977433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.977742 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.978050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.978357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.978675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.978993 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.979316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.979623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.979944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.980355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.980604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.980910 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.981291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.981593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.981901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.982220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.982537 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.982842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.983148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.983451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.983767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.984102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.984411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.984664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.984964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.985285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.985605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.985909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.986214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.986517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.986817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.987125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.987429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.987732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.988036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.988340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.988642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.988945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.989267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.990108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.990414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.990734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.991053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.991359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.991665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.991971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.992277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.992674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.992989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.993356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.993677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.994201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.994508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.994867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.995141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.995447 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.995769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.996073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.996379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.997464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.997464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.997464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.997895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.997895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.998163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.998464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.998945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.999312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.999555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:35.999876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.000187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.000499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.000896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.001203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.001551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.001896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.002228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.002573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.002888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.003218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.003549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.003867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.004180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.004493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.004824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.005778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.006092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.006408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.006726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.007049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.007382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.007697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.008011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.008329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.008661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.008955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.009305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.009640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.009950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.010296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.010645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.010962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.011288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.011614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.011927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.012237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.012547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.012890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.013206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.013549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.013871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.014184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.014507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.014827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.015141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.015453 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.015765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.016077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.016414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.016730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.017053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.017397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.017712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.018031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.018344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.018656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.018968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.019273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.019578 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.019885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.020192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.020496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.020849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.021175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.021507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.021844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.022152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.022462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.022773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.023082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.023390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.023701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.024013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.024320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.024641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.024958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.025353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.025719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.026033 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.026951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.026951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.026951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.027425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.027631 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:56:36.028115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.028262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:56:36.028412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.028412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.028707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:56:36.028848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.029132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:56:36.029305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.029462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:56:36.029621 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.029770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.029920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.030072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.030220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.030370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.030532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.030691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.030834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.030992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.031134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.031283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.031426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.031573 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.031713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.031713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.031989 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.032138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.032279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.032279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.032565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.032565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.032785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.032881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.033003 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859317-1-iscsi {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.033162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.033427 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.033782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.033941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.034094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.034249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.034373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.034542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.034692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.034858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.035114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.035208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.035423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.035516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.035728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.036000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.036108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.036348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.036455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.036663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.036776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.036981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.037073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.037351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.037493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.037680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.037795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.038031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.038198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.038420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.038523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.038781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.038892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.039152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.039317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.039472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.039620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.039771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.039879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859317-1-iscsi {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.040075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.040175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.040396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.040488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.040710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.040812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.041030 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.041171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.041362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.041519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.041688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.041838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.041999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.042168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.042415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.042553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.042727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.042863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.043043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.043186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.043383 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.043476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.043785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.043913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.044112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.044245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.044420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.044794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.044934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.045117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.045300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.045470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.045602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.045782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.045913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.046093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.046270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.046393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.046584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.046688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.046966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.047103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.047294 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.047427 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.047620 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.047764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.047877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.047977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.048131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.048225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.048453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.048556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.048777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.048870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.049095 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.049210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.049468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.049580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.049776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.049875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.050087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.050185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.050400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.050504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.050712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.050814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.051021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.051118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.051332 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.051431 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.051641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.051739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.052477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.052623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.052789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.052957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.053101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.053298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.053445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.053628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.053729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.054018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.054166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.054330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.054464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.054643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.054738 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.054940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.055065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.055253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.055396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.055565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.055749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.055869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.056073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.056166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.056400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.056502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.056715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.056814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.057027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.057126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.057369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.057464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.057697 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.057790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.058023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.058112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.058328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.058420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.058580 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.058678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.058887 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.058987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.059196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.059298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.059533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.059654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.059841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.059943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.060151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.060250 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.060459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.060560 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.060773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.060879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.061089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.061196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.061433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.061540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.061746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.061860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.062056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.062153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.062365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.062469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.062671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.062778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.062998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.063111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.063302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.063432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.063604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.063765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.063910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.063998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.064212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.064304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.064524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.064631 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.064833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.064924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.065150 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.065278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.065484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.065586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.065796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.065926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.066108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.066254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.066416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.066568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.066727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.066881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.067048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.067192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.067564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.067666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.068368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.068475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.068692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.068842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.069007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.069150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.069345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.069643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.069803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.069943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.070114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.070246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.070429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.070559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.070783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.070903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.071095 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.071227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.071409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.071538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.071714 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.071839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.072020 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.072140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.072328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.072453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.072632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.072761 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.072938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.073064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.073278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.075901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.075982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.076072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:56:36.076270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.076976 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077150 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.077801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.078037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.078146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.078344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.078474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.078699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.079908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080010 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.080961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.081916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082239 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082754 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.082854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.083088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.083714 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.083894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.084827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.085881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.086801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087020 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.087963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.088988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.089970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090777 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.090870 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091197 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.091806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.092927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.093893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.094907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.095825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096465 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.096931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097763 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.097887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.098912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.099623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.099736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.099958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.100083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.100273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.100366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.100588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.100771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.101041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.101183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.101404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.101534 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.101738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.102058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.102364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.102541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.102672 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.102885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103214 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.103978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.104930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.105130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.109943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.110942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.111979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112051 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112615 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112855 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.112924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.113564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114226 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.114779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.115039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.115125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.115198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116372 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116738 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.116890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.117834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118219 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.118993 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.119980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120761 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.120994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.121942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.122884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.123803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.124968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.125130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.125371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.125543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.126277 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.126468 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.126629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.126791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.126941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.127895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.128968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.129126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.129295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.129471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.129622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.129773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.130429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.130595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.130759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.130918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.131861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.132789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133083 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.133926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.134861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.135876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.137091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.137281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.137457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.137610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.137858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.138907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.139884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.140978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.141986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.142923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.143902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.144214 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.144372 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.144522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.144672 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.144672 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.145717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.146915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.147863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148014 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.148839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149004 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149761 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.149936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.150235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.150387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.150544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.150694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.150850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.151949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.152885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.153055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.153235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.153571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.153732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.153882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.154980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.155975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.156127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.156286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.157925 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.158808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.158981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159300 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.159867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.160982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.161141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.161485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.161641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.161802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.161963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.162918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163232 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.163889 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164040 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.164993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.165144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.165368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.165534 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.165741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.165927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.166080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.166237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.166387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.167503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.167689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.167853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.168973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.169133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.169337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.169497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.169655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.169809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170571 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.170887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.171854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172004 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172320 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.172945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173320 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.173935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174545 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.174843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.175845 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176482 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.176901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.177613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.177791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.177944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178253 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.178889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.179843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.180002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.180273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.180443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.181925 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182395 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.182965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183598 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.183899 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.184989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.185307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.185484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.185644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.185806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186014 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.186779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.187064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.187778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.187942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.188108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.188405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.188405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.188755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.188921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.189906 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.190966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191130 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191432 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.191903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.192063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.192223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.192374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.192374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.193178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.193409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.193562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.193719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.193872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.194878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195189 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.195845 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.196856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.197026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.197297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.198973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.199147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.199299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.199449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.199598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.199842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200024 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.200909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201213 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.201919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.202865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.203950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.204943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.205939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.206933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.207091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.207278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.207548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.208903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209082 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.209923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.210081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.210267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.210476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.210654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.210915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211258 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.211898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.212839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.213827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.214955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.215114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.215291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.215454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.215632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.215929 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.216158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.216327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.216489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.216731 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.216886 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.217050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.217203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.217391 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.217600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.217600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.218415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.218579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.218748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.219222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.219385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.219548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.219710 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.219862 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.220973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.221157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.221458 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.221620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.221779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.221931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.222878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223040 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223365 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223518 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.223953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.224301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.224461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.224611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.224776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.224947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.225921 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.226941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227427 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.227884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.228062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.228675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.228848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.229935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.230848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.231935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.232872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.233168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.233403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.233558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.233732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.233891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234139 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.234950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.235248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.235406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.235566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.235725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.235888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.236906 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237065 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237261 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.237971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.239882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.241029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.242368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.243407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.244703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.245895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.247117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.248282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.250157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.251317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.251317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.251317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.251317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.251317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.252157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.252157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.252157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.252606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.252776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.253007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.253341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.253658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.253970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.254295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.254597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.255415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.255835 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.256151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.256469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.256831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.257798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.258125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.258463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.258896 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.259287 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.259447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.259775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.260050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.260374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.260693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.261055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.261408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.261963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.262310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.262637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.262978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.263318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.263633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.263947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.264261 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.265333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.265333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.265333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.265796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.265947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.266140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.266456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.266772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.267087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.267403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.267718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.268035 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.268351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.271839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.273975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.274139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.274405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.274868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.275191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.275516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.275848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.276164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.276492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.276820 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.277139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.277507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.277827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.278165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.278514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.278856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.280856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.281008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.281338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.281650 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.281988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.282262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.282640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.282882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.283193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.283760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.283935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO dbcounter [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Registered counter for database nova_api Sep 26 17:56:36.284102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.284369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.284685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.284985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.285323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.285637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.285951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.286283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.286595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.286903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.287213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.287520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.287858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.288199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.288519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.288853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.289171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.290029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.290029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.290361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.290512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.290771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.291086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.291426 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.291742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.292076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.292375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.293507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.293507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.293507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.293966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.293966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.294280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.294579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.294903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.295237 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.295578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.295917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.296254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.296571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.296889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.297206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.297544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.297859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.298181 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.298496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.300439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.300439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.300439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.301142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.301142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.304165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.304557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.304982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.306071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.306269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_db.sqlalchemy.engines [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.306444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.306444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.306771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.307231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.307417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.307886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:56:36.308306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:56:36.312648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writer thread running {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.368229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.context [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6eded39c-877a-426d-8a1f-1043d953fe22(cell1) {{(pid=132949) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:56:36.369625 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO dbcounter [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Registered counter for database nova_api Sep 26 17:56:36.372220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:56:36.372691 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:56:36.374291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:56:36.375014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:56:36.375465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:56:36.377481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:56:36.379503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO dbcounter [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Registered counter for database nova_cell0 Sep 26 17:56:36.384122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO dbcounter [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Registered counter for database nova_cell1 Sep 26 17:56:36.391022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_db.sqlalchemy.engines [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.392738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_db.sqlalchemy.engines [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.393611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_db.sqlalchemy.engines [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.398338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writer thread running {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.401804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writer thread running {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.403233 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writer thread running {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.454156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.context [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6eded39c-877a-426d-8a1f-1043d953fe22(cell1) {{(pid=132948) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:56:36.458799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:56:36.459220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:56:36.460829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:56:36.461585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:56:36.462044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:56:36.464058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:56:36.466096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO dbcounter [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Registered counter for database nova_cell0 Sep 26 17:56:36.470103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO dbcounter [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Registered counter for database nova_cell1 Sep 26 17:56:36.477310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_db.sqlalchemy.engines [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.478975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_db.sqlalchemy.engines [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.484968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writer thread running {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.486998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writer thread running {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.555418 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO dbcounter [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Registered counter for database nova_cell0 Sep 26 17:56:36.562058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_db.sqlalchemy.engines [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.566394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writer thread running {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.633248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO dbcounter [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Registered counter for database nova_cell0 Sep 26 17:56:36.640093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_db.sqlalchemy.engines [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:56:36.644452 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writer thread running {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:56:36.893049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: WARNING keystonemiddleware.auth_token [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:56:36.900530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: WARNING keystonemiddleware.auth_token [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:56:36.964428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: WARNING keystonemiddleware.auth_token [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:56:36.971718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: WARNING keystonemiddleware.auth_token [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:56:37.253340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: WARNING keystonemiddleware.auth_token [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:56:37.259953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: WARNING keystonemiddleware.auth_token [None req-20147bb8-b101-4a9e-8357-9d62c4c244b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:56:37.265273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561fbce69c0 pid: 132949 (default app) Sep 26 17:56:37.315905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: WARNING keystonemiddleware.auth_token [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:56:37.322549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: WARNING keystonemiddleware.auth_token [None req-b1589005-d2ff-4b3d-af9a-b96eded2d359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:56:37.327852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561fbce69c0 pid: 132948 (default app) Sep 26 17:57:14.749982 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.752881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.754858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.756352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.890956 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.892628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.894261 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:14.895152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:15.709376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-501f49e2-ef4b-4392-b2ca-2a7086a1e378 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Action: 'create', calling method: .version_select at 0x7ff982d674c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-278355298", "metadata": {"Type": "work"}}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-501f49e2-ef4b-4392-b2ca-2a7086a1e378 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 121 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:15.716834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-278355298", "metadata": {"Type": "work"}}} Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:15.718368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-278355298', 'metadata': {'Type': 'work'}}}} Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise error Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:15.733750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 17:57:15.735658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-501f49e2-ef4b-4392-b2ca-2a7086a1e378 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-501f49e2-ef4b-4392-b2ca-2a7086a1e378 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.986972 Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 17:57:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 990 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 17:57:15.739032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-029680b6-46fa-4510-a87e-4d3d5dca8ff8 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Action: 'create', calling method: .version_select at 0x7ff982d67dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1876214097", "metadata": {"Type": "work"}}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-029680b6-46fa-4510-a87e-4d3d5dca8ff8 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 120 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:15.741688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1876214097", "metadata": {"Type": "work"}}} Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:15.744956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1876214097', 'metadata': {'Type': 'work'}}}} Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise error Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi '0' Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:15.748197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 17:57:15.751778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-029680b6-46fa-4510-a87e-4d3d5dca8ff8 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-029680b6-46fa-4510-a87e-4d3d5dca8ff8 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015820 Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 17:57:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da263f3c-8ed1-4a44-aae2-bc4a80e03c0a tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Action: 'create', calling method: .version_select at 0x7ff982c251f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1002909192", "metadata": {"Type": "work"}}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da263f3c-8ed1-4a44-aae2-bc4a80e03c0a tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 17:57:15.757587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 119 Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:15.758196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1002909192", "metadata": {"Type": "work"}}} Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1002909192', 'metadata': {'Type': 'work'}}}} Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise error Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi '' Sep 26 17:57:15.759603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.763072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da263f3c-8ed1-4a44-aae2-bc4a80e03c0a tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-da263f3c-8ed1-4a44-aae2-bc4a80e03c0a tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009210 Sep 26 17:57:15.765441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 3/3] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 17:57:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 17:57:15.767508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-22557b1d-5cdb-4af1-89e9-ee6cca9f0f74 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Calling method '.version_select at 0x7ff982c25c10>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:15.969115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-119cc28c-3cab-451e-a510-1b7d0e251960 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Action: 'create', calling method: .version_select at 0x7ff982d69430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-323758304"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:16.197367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-22557b1d-5cdb-4af1-89e9-ee6cca9f0f74 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] HTTP exception thrown: Volume tempest-invalid-1587149322 could not be found. Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-22557b1d-5cdb-4af1-89e9-ee6cca9f0f74 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1587149322 HTTP/1.1 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:16.201916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Volume tempest-invalid-1587149322 could not be found. Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'tempest-invalid-1587149322'} Sep 26 17:57:16.203591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1587149322 could not be found. (HTTP 404) (Request-ID: req-7baa825b-15fc-4524-a074-241d1bb2bd30) Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.209580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:16.215370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1587149322 could not be found. Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:16.217705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1587149322 could not be found. Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1587149322 could not be found. Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-22557b1d-5cdb-4af1-89e9-ee6cca9f0f74 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 404 to user: Volume tempest-invalid-1587149322 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-22557b1d-5cdb-4af1-89e9-ee6cca9f0f74 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1587149322" status: 404 len: 99 microversion: 2.1 time: 0.444395 Sep 26 17:57:16.219515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 17:57:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1587149322 => generated 99 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 26 17:57:16.222114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dac42041-1a35-463a-8720-383373b638d3 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005117 Sep 26 17:57:16.222603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 17:57:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 26 17:57:16.240924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bfd65277-15d9-4b4e-9df6-72208dbbac9f tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006065 Sep 26 17:57:16.242030 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Sep 26 17:57:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 17:57:16.254536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-692f3ce4-12c8-4ca1-b56d-8ef2310ee02d tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Calling method '.version_select at 0x7ff982ba6e50>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-692f3ce4-12c8-4ca1-b56d-8ef2310ee02d tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] HTTP exception thrown: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-692f3ce4-12c8-4ca1-b56d-8ef2310ee02d tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/os-volumes/166f628f-de8d-4cf2-b9c5-851e9ef04452 HTTP/1.1 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:16.344328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '166f628f-de8d-4cf2-b9c5-851e9ef04452'} Sep 26 17:57:16.345911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. (HTTP 404) (Request-ID: req-d998a033-28d9-4e39-9a24-7fd50ee558ad) Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.346677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:16.352177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 17:57:16.353280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-692f3ce4-12c8-4ca1-b56d-8ef2310ee02d tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 404 to user: Volume 166f628f-de8d-4cf2-b9c5-851e9ef04452 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-692f3ce4-12c8-4ca1-b56d-8ef2310ee02d tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/166f628f-de8d-4cf2-b9c5-851e9ef04452" status: 404 len: 109 microversion: 2.1 time: 0.097772 Sep 26 17:57:16.354348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 7/7] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 17:57:16 2022] DELETE /compute/v2.1/os-volumes/166f628f-de8d-4cf2-b9c5-851e9ef04452 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:57:16.360610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-764ea29e-a053-46f9-84b8-0d181edad7d0 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Calling method '.version_select at 0x7ff982b585e0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:16.416894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-764ea29e-a053-46f9-84b8-0d181edad7d0 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] HTTP exception thrown: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-764ea29e-a053-46f9-84b8-0d181edad7d0 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Request method failure captured: Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/os-volumes/1da1661d-5d25-492e-8f28-5c70532cb902 HTTP/1.1 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6ZlmTu9sh-ztagROTOcmSdzybmzRwNgbq-GTjhL9zSMRyt-JH0tqRotmWfiAEOD-PZba4rtwBzvRXdyp2XihjqhIYHHhd8Zy4hLJXaJWCV_xfJm6p32bRFmjAq3QbBECRatTQRUeRFfniXUh5B_1OMZ_CshB9a7M8EX-VamCipYc Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:16.420745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d7b781a603458b86383cfa2ae8e0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d7b781a603458b86383cfa2ae8e0a4"}]}] Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 86d7b781a603458b86383cfa2ae8e0a4 Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1112104573 Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: b2e7c83acd4440fa8800343ba283a0d5 Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1112104573-project Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '1da1661d-5d25-492e-8f28-5c70532cb902'} Sep 26 17:57:16.422932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. (HTTP 404) (Request-ID: req-b6f05350-7e14-491d-8a6f-a09e680ba17f) Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.423702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:16.424864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 17:57:16.428528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-764ea29e-a053-46f9-84b8-0d181edad7d0 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] Returning 404 to user: Volume 1da1661d-5d25-492e-8f28-5c70532cb902 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-764ea29e-a053-46f9-84b8-0d181edad7d0 tempest-VolumesNegativeTest-1112104573 tempest-VolumesNegativeTest-1112104573-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1da1661d-5d25-492e-8f28-5c70532cb902" status: 404 len: 109 microversion: 2.1 time: 0.070021 Sep 26 17:57:16.432499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 8/8] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:16 2022] GET /compute/v2.1/os-volumes/1da1661d-5d25-492e-8f28-5c70532cb902 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:57:17.751011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-119cc28c-3cab-451e-a510-1b7d0e251960 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.865797 Sep 26 17:57:17.752673 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 1/9] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Sep 26 17:57:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2870 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 17:57:17.768212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ea95dc4e-8a0a-4918-a87a-4c7cf41b03ca tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982ba6d30>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:17.882533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ea95dc4e-8a0a-4918-a87a-4c7cf41b03ca tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 200 len: 344 microversion: 2.1 time: 0.118132 Sep 26 17:57:17.883140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 9/10] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:17 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:18.900344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4a4e9ba6-2d23-416c-979f-f45f9df0f3ff tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d310>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:19.011286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4a4e9ba6-2d23-416c-979f-f45f9df0f3ff tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 200 len: 344 microversion: 2.1 time: 0.116283 Sep 26 17:57:19.011862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 2/11] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:18 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:20.030193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9307e2c1-d204-4092-b715-cb4725369ba9 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b583a0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:20.155548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9307e2c1-d204-4092-b715-cb4725369ba9 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 200 len: 345 microversion: 2.1 time: 0.131261 Sep 26 17:57:20.161085 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 10/12] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:20 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:20.173730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1cbc2a7c-7e4b-4160-a14c-068e50c5ba83 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Action: 'create', calling method: .version_select at 0x7ff982c3d940>, body: {"snapshot": {"volume_id": "05444ade-c2a2-44dd-9fce-901258e8db6d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-326523093"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:21.086507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1cbc2a7c-7e4b-4160-a14c-068e50c5ba83 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.917064 Sep 26 17:57:21.094721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 3/13] 10.222.0.49 () {60 vars in 1162 bytes} [Mon Sep 26 17:57:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:21.111255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c706301f-c2ec-45e4-837b-b2865261ed22 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b5f0d0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:21.171574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c706301f-c2ec-45e4-837b-b2865261ed22 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.076192 Sep 26 17:57:21.172340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 11/14] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:21 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:57:21.183698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8e6227c6-b97f-4b94-a172-8e0ff36f02d3 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982bd6c10>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:21.269701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8e6227c6-b97f-4b94-a172-8e0ff36f02d3 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.089694 Sep 26 17:57:21.271475 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 4/15] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 17:57:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:21.286763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-59a6c268-0c50-4bb7-aeab-9ce811ab0a14 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b58550>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:21.356715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-59a6c268-0c50-4bb7-aeab-9ce811ab0a14 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.077536 Sep 26 17:57:21.362679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 12/16] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:21 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:22.430288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bcffdfee-295c-4b18-aa76-f34cd27970e1 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982d69550>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:22.435783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bcffdfee-295c-4b18-aa76-f34cd27970e1 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.069200 Sep 26 17:57:22.436353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 5/17] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:22 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:23.450804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f9ffb600-1a36-4075-8a28-cf9b35e47729 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982ba69d0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:23.625165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f9ffb600-1a36-4075-8a28-cf9b35e47729 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.180038 Sep 26 17:57:23.625758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 13/18] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:23 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:24.638483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-311e6f67-e60a-42fa-9e9a-9f4706731651 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d940>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:24.710813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-311e6f67-e60a-42fa-9e9a-9f4706731651 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.076244 Sep 26 17:57:24.712503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 6/19] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:24 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:25.725932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9d799c9f-833a-44bc-b962-b2f601fc0c55 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b5f3a0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:25.776868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9d799c9f-833a-44bc-b962-b2f601fc0c55 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 287 microversion: 2.1 time: 0.056374 Sep 26 17:57:25.777533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 14/20] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:25 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:25.790755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d45347a1-c65d-4ae5-89eb-9bd8ecc0f44d tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d280>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:25.985896 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d45347a1-c65d-4ae5-89eb-9bd8ecc0f44d tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 202 len: 0 microversion: 2.1 time: 0.199059 Sep 26 17:57:25.986459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 7/21] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Sep 26 17:57:25 2022] DELETE /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 17:57:25.995235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b00394e6-dff0-4cea-91f7-c16066eab3a6 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982ba6a60>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:26.086273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b00394e6-dff0-4cea-91f7-c16066eab3a6 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 200 len: 286 microversion: 2.1 time: 0.094986 Sep 26 17:57:26.087067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 15/22] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:25 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:27.102775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9ef97b05-6afc-43b3-bec0-c39a609175c2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d8b0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:27.173694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-9ef97b05-6afc-43b3-bec0-c39a609175c2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] HTTP exception thrown: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9ef97b05-6afc-43b3-bec0-c39a609175c2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Request method failure captured: Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c HTTP/1.1 Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMef6clL42L0Hxd_BW5ffuEUKMl7XNDqnKfI4hBUwK8qHNinxUtZ6A4QdMHSepkUa6Wu63MmUR2GeIHYEqkJSqkj8JlpVkyOBgqgUEWVSHIL1X6nKrAAL6wnXiHYLFoNwlxjFKVNDpBNSF5aNeMC34M9e22tSBZ1_hXdpdkElOopwnws Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 17:57:27.211304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fa851d06016040bd8c2bf4e23c133fbd"}]}] Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: d37a54b6f7754f7090c0ed21dba4ce8e Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '09309401-f656-4d7f-afc5-83cc44b2235c'} Sep 26 17:57:27.212910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. (HTTP 404) (Request-ID: req-a65e2f42-2e34-4110-b824-1729485d3a91) Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.216400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:27.220802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 17:57:27.225982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9ef97b05-6afc-43b3-bec0-c39a609175c2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Returning 404 to user: Snapshot 09309401-f656-4d7f-afc5-83cc44b2235c could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:27.229695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9ef97b05-6afc-43b3-bec0-c39a609175c2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c" status: 404 len: 111 microversion: 2.1 time: 0.094579 Sep 26 17:57:27.232039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 8/23] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 17:57:27 2022] GET /compute/v2.1/os-snapshots/09309401-f656-4d7f-afc5-83cc44b2235c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:57:27.248149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-72c43462-a8c6-4fde-820c-1a36a0a0c9df tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b58940>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:27.510442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-72c43462-a8c6-4fde-820c-1a36a0a0c9df tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 202 len: 0 microversion: 2.1 time: 0.296329 Sep 26 17:57:27.510442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 16/24] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 17:57:27 2022] DELETE /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 17:57:27.515868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c3d77dcb-3918-43d6-b8c7-32f93468e7ec tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d3a0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:27.605381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c3d77dcb-3918-43d6-b8c7-32f93468e7ec tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 200 len: 344 microversion: 2.1 time: 0.095333 Sep 26 17:57:27.606981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 9/25] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:27 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:28.624682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-33250995-b387-403e-adb7-f1281d0d1cd2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b5f5e0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:28.695703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-33250995-b387-403e-adb7-f1281d0d1cd2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] HTTP exception thrown: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-33250995-b387-403e-adb7-f1281d0d1cd2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Request method failure captured: Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d HTTP/1.1 Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6clL42L0Hxd_BW5ffuEUKMl7XNDqnKfI4hBUwK8qHNinxUtZ6A4QdMHSepkUa6Wu63MmUR2GeIHYEqkJSqkj8JlpVkyOBgqgUEWVSHIL1X6nKrAAL6wnXiHYLFoNwlxjFKVNDpBNSF5aNeMC34M9e22tSBZ1_hXdpdkElOopwnws Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:28.706169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fa851d06016040bd8c2bf4e23c133fbd"}]}] Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: d37a54b6f7754f7090c0ed21dba4ce8e Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '05444ade-c2a2-44dd-9fce-901258e8db6d'} Sep 26 17:57:28.707369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. (HTTP 404) (Request-ID: req-dfa470e4-d4c8-442d-a886-96baf132ae7a) Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.708016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:28.709289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 17:57:28.710696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.712569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.719072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-33250995-b387-403e-adb7-f1281d0d1cd2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Returning 404 to user: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:28.720248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-33250995-b387-403e-adb7-f1281d0d1cd2 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 404 len: 109 microversion: 2.1 time: 0.102514 Sep 26 17:57:28.737804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 17/26] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:28 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:57:28.744459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2c4e2a6a-8567-4f3f-8a91-8b2f4e86e76a tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982c3d700>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:28.812627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-2c4e2a6a-8567-4f3f-8a91-8b2f4e86e76a tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] HTTP exception thrown: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2c4e2a6a-8567-4f3f-8a91-8b2f4e86e76a tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Request method failure captured: Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: DELETE /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d HTTP/1.1 Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMef6clL42L0Hxd_BW5ffuEUKMl7XNDqnKfI4hBUwK8qHNinxUtZ6A4QdMHSepkUa6Wu63MmUR2GeIHYEqkJSqkj8JlpVkyOBgqgUEWVSHIL1X6nKrAAL6wnXiHYLFoNwlxjFKVNDpBNSF5aNeMC34M9e22tSBZ1_hXdpdkElOopwnws Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 17:57:28.816034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fa851d06016040bd8c2bf4e23c133fbd"}]}] Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: d37a54b6f7754f7090c0ed21dba4ce8e Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '05444ade-c2a2-44dd-9fce-901258e8db6d'} Sep 26 17:57:28.817045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. (HTTP 404) (Request-ID: req-2ae7150e-84a9-45de-a6f4-6f8e93e6082e) Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.818102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 17:57:28.819073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 17:57:28.819933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.820822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.823672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2c4e2a6a-8567-4f3f-8a91-8b2f4e86e76a tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Returning 404 to user: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:28.824739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2c4e2a6a-8567-4f3f-8a91-8b2f4e86e76a tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 404 len: 109 microversion: 2.1 time: 0.090615 Sep 26 17:57:28.829751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 10/27] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 17:57:28 2022] DELETE /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 17:57:28.838258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-18cb13ca-044c-4f1e-95ad-3e9b9bdf1b69 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Calling method '.version_select at 0x7ff982b58dc0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:28.892953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-18cb13ca-044c-4f1e-95ad-3e9b9bdf1b69 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] HTTP exception thrown: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-18cb13ca-044c-4f1e-95ad-3e9b9bdf1b69 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Request method failure captured: Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d HTTP/1.1 Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMef6clL42L0Hxd_BW5ffuEUKMl7XNDqnKfI4hBUwK8qHNinxUtZ6A4QdMHSepkUa6Wu63MmUR2GeIHYEqkJSqkj8JlpVkyOBgqgUEWVSHIL1X6nKrAAL6wnXiHYLFoNwlxjFKVNDpBNSF5aNeMC34M9e22tSBZ1_hXdpdkElOopwnws Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:57:28.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fa851d06016040bd8c2bf4e23c133fbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fa851d06016040bd8c2bf4e23c133fbd"}]}] Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: fa851d06016040bd8c2bf4e23c133fbd Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1645143965 Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: d37a54b6f7754f7090c0ed21dba4ce8e Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1645143965-project Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '05444ade-c2a2-44dd-9fce-901258e8db6d'} Sep 26 17:57:28.895401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. (HTTP 404) (Request-ID: req-17e3e311-85b5-409e-97ca-1a697fcd6f85) Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.896015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 17:57:28.896881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 17:57:28.898648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. Sep 26 17:57:28.899489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:57:28.903016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-18cb13ca-044c-4f1e-95ad-3e9b9bdf1b69 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] Returning 404 to user: Volume 05444ade-c2a2-44dd-9fce-901258e8db6d could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:57:28.904237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-18cb13ca-044c-4f1e-95ad-3e9b9bdf1b69 tempest-VolumesSnapshotsTestJSON-1645143965 tempest-VolumesSnapshotsTestJSON-1645143965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d" status: 404 len: 109 microversion: 2.1 time: 0.074461 Sep 26 17:57:28.905790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 17:57:28 2022] GET /compute/v2.1/os-volumes/05444ade-c2a2-44dd-9fce-901258e8db6d => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:57:31.329859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1708931799", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:31.543925 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] validate_networks() for [('d5c08d16-21cf-4774-99c2-a11d7b1a50a8', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:31.711462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1383463269", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "networks": [{"uuid": "680642b0-d74e-45e5-b069-df22d4ab0dea"}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:31.946025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] validate_networks() for [('680642b0-d74e-45e5-b069-df22d4ab0dea', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:33.727929 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:33.728527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:33.728916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:33.729427 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:33.729835 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:33.767047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:33.769868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:33.777576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:33.779740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:33.780612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:33.781433 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:33.842039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:33.850462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for user 0416809c467846428e7df9a7c11ffb0e and project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:33.868111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:33.889359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:34.034334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:34.034334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:34.034334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:34.034334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:34.034334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:34.096387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:34.096878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:34.097498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:34.098266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:34.104853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:34.105418 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:34.208553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Getting quotas for project 6cd1fad813d94b6cba21a788b11d2cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:34.227111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Getting quotas for user 3b0cc3751553491ba18b9a6f2e2f5e14 and project 6cd1fad813d94b6cba21a788b11d2cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:34.255399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:34.257539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-849dc230-4941-4d8a-b483-380f934494e8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.392627 Sep 26 17:57:34.260665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:34.266901 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 11/29] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:57:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 17:57:34.520108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e4acea18-ea2f-41bd-8a63-212a8afd9a31 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.382858 Sep 26 17:57:34.520864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 19/30] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 17:57:34.531897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8c6412fc-8e5a-4625-a355-5122fbac1fce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:34.532341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8c6412fc-8e5a-4625-a355-5122fbac1fce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:34.657558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dee416d4-bfaf-4d2c-9b7b-f3bbf377e8f8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: .version_select at 0x7ff982bb65e0>, body: {"keypair": {"name": "tempest-keypair-1427134022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJV4JffkhebPMP3PH4o5mw5Qgj9ePxhMwHd79T93y6m2II29rnt+LEPR8Z3xcveKOaYMJiQMp7aObOGpFMrvAv16KxXvGhMG14FnHRVbYiyJf1aWbhslg/Y6hx4KLlsVA=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:34.744898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-dee416d4-bfaf-4d2c-9b7b-f3bbf377e8f8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:34.758519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-dee416d4-bfaf-4d2c-9b7b-f3bbf377e8f8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:34.966719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dee416d4-bfaf-4d2c-9b7b-f3bbf377e8f8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.697383 Sep 26 17:57:34.969172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 12/31] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 17:57:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:35.053068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8c6412fc-8e5a-4625-a355-5122fbac1fce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:35.086047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8c6412fc-8e5a-4625-a355-5122fbac1fce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1222 microversion: 2.1 time: 0.563926 Sep 26 17:57:35.092359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 20/32] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:34 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1222 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:35.116055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3e35ea02-728e-4387-aa38-7c672e839693 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:35.139990 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3e35ea02-728e-4387-aa38-7c672e839693 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:35.533440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e35ea02-728e-4387-aa38-7c672e839693 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:35.549311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3e35ea02-728e-4387-aa38-7c672e839693 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1215 microversion: 2.1 time: 0.433268 Sep 26 17:57:35.549311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 21/33] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:35 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:35.633834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-449243174", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:35.754685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] validate_networks() for [('d5c08d16-21cf-4774-99c2-a11d7b1a50a8', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:35.827346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ffef7aa9-f6b9-49f6-b41b-ab7119d37efa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: .version_select at 0x7ff9822535e0>, body: {"keypair": {"name": "tempest-keypair-2056424971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs8EQJMPx96g3EMKDGnQD7ujMta7yJPRPlm3i0wfaMNePFqFL5jRXThHFduTmCo9+wHY70YAbIKrIZa2XJkI8m4/Foi4jK4plbxS7LBNdGvAh8xJVdlbm59k9uX92AU9Q=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:35.889281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-ffef7aa9-f6b9-49f6-b41b-ab7119d37efa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for project 641b37d85a344b1791fcdff859318e42. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:35.894216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-ffef7aa9-f6b9-49f6-b41b-ab7119d37efa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for user e18ae5c3b0d54666afc4b308831edf04 and project 641b37d85a344b1791fcdff859318e42. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:36.109894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ffef7aa9-f6b9-49f6-b41b-ab7119d37efa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.140987 Sep 26 17:57:36.110847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 13/34] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 17:57:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 17:57:36.751883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:36.752995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:36.753840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:36.756038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:36.756038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:36.776932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:36.776932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:36.776932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:36.778719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:36.780868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:36.782232 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:36.841919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:36.860125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for user 0416809c467846428e7df9a7c11ffb0e and project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:36.895088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:36.903505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:36.953407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d5bff4a2-09b2-4146-bbee-2ad7c8e9021d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: .version_select at 0x7ff9822788b0>, body: {"keypair": {"name": "tempest-keypair-86825364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm02EYAC8UO/BIPf7ZsH4P4gOa8TuvSNR7KoXrEf42sXOCZpOu4WnU8D/8QTV0NUmPCRfGDNlke4THNcaj6FCaDv3b52Bl9ZCfuyL1ozEsLcrjDBeKYsOCcMcA41NCXfA=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:37.007622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-d5bff4a2-09b2-4146-bbee-2ad7c8e9021d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:37.032542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-d5bff4a2-09b2-4146-bbee-2ad7c8e9021d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for user 2020860051d44960a924b62989a7988b and project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:37.185034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4bb1f7e7-8a0d-4ea1-8b57-b54ee3709445 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.555871 Sep 26 17:57:37.196601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 22/35] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:57:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 17:57:37.196601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-56c33300-e3b6-417c-908d-c8b8c21fe5eb tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:37.202472 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-56c33300-e3b6-417c-908d-c8b8c21fe5eb tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:37.215154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d5bff4a2-09b2-4146-bbee-2ad7c8e9021d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.679622 Sep 26 17:57:37.224919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 14/36] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 17:57:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:57:37.235670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a2f84b20-e4fd-4689-82ec-d76b36c64969 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:37.241439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a2f84b20-e4fd-4689-82ec-d76b36c64969 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:37.788702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a2f84b20-e4fd-4689-82ec-d76b36c64969 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:37.789999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-56c33300-e3b6-417c-908d-c8b8c21fe5eb tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:37.789999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-56c33300-e3b6-417c-908d-c8b8c21fe5eb tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1215 microversion: 2.1 time: 0.519581 Sep 26 17:57:37.789999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 23/37] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:37 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1215 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:37.791696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a2f84b20-e4fd-4689-82ec-d76b36c64969 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1221 microversion: 2.1 time: 0.509215 Sep 26 17:57:37.791696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 15/38] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:37 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1221 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:38.742084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:38.743388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:38.763135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:38.763616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:38.764047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:38.765591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cebb8ae0-5a08-4e98-966c-ce022cc863b9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:38.766213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cebb8ae0-5a08-4e98-966c-ce022cc863b9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:38.767928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:38.771933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:38.773705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:38.954231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cebb8ae0-5a08-4e98-966c-ce022cc863b9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:38.962338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cebb8ae0-5a08-4e98-966c-ce022cc863b9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1221 microversion: 2.1 time: 0.201053 Sep 26 17:57:38.970295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 16/39] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:38 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:39.215121 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:39.268583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8aacc0f0-c1a6-4a72-a9de-77172c5235de tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1219 microversion: 2.1 time: 0.531559 Sep 26 17:57:39.291017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 24/40] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:38 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1219 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:39.996213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:39.997588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:40.020330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:40.022336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:40.023753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:40.024684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:40.026753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:40.031845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:40.331682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:40.332742 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:40.366712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:40.379003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:40.379962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:40.380918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:40.381605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:40.382212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:40.448743 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:40.501520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3108b68e-f8f7-4c1b-84c1-fe0b8a9609f2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1217 microversion: 2.1 time: 0.508870 Sep 26 17:57:40.505397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 17/41] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:39 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1217 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:40.930445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:40.944148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3854fea1-f41e-4f8b-8483-ea78e66d6909 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1211 microversion: 2.1 time: 0.620486 Sep 26 17:57:40.949028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 25/42] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:40 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1211 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:41.527918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:41.528594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:41.537770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:41.538264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:41.538703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:41.539404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:41.567418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:41.567890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:41.799180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-694580322", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e6512-8e6a-49d8-93c1-8bd9f672b2d7"}], "security_groups": [{"name": "tempest-securitygroup--1226477124"}], "key_name": "tempest-keypair-2056424971", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:41.976391 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:41.996693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a48a5450-81bf-439b-bcba-45c3f3eeee07 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1273 microversion: 2.1 time: 0.467294 Sep 26 17:57:41.996693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 18/43] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:41 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:42.022322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:42.024374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:42.037743 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:42.040184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:42.040877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:42.041885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:42.046666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:42.050423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:42.180235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] validate_networks() for [('ab7e6512-8e6a-49d8-93c1-8bd9f672b2d7', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:42.352646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:42.365165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d32e77d3-dc85-48d8-9499-29605dcc2db8 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1275 microversion: 2.1 time: 0.361304 Sep 26 17:57:42.385506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 19/44] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:41 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:42.820622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-573041504", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c4905c3-b6d4-4b95-988f-f86fad27c092"}], "security_groups": [{"name": "tempest-securitygroup--1165023095"}], "key_name": "tempest-keypair-1427134022", "user_data": "}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:43.541646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] validate_networks() for [('5c4905c3-b6d4-4b95-988f-f86fad27c092', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:43.804211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:45.807816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:45.808347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:45.808910 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:45.809791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:45.812829 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:45.858234 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:45.866974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:45.872310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:45.875877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:45.880836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:45.882194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:45.957685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for project 641b37d85a344b1791fcdff859318e42. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:45.966928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for user e18ae5c3b0d54666afc4b308831edf04 and project 641b37d85a344b1791fcdff859318e42. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:45.996470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:46.032403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:46.208392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e44e3f92-06f2-4ee0-9d25-3d5713becfa8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.413614 Sep 26 17:57:46.217104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 26/45] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 17:57:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 4423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 26 17:57:46.222305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.225607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:46.249049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:46.249049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:46.249049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:46.249049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:46.262821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:46.263408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:46.491830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:46.510421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d9ff9c68-98aa-47ac-9ca7-42626e5439f8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1279 microversion: 2.1 time: 0.291066 Sep 26 17:57:46.512831 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 27/46] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:46.541096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.544970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:46.560374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:46.561852 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:46.562949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:46.565596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:46.566321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:46.569846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:46.994853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:46.995472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:47.002846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:47.002846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:47.002846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:47.075395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:47.078155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:47.082129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:47.085008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:47.085686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:47.115137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:47.190257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:47.196254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:47.225753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:47.229168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:47.369715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.390468 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a48a3196-f24b-44aa-9c0f-cb71c6881041 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.874620 Sep 26 17:57:47.391971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 28/47] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:47.406413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:47.407532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:47.594834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-45475da6-e78e-408c-96bf-f522ef80d7ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.776360 Sep 26 17:57:47.595133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 20/48] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:57:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 4779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 17:57:47.618147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:47.618147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:47.663424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:47.664123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:47.665827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:47.667479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:47.668890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:47.670763 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:47.741154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.751551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.769136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.770668 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3e423306-3275-4e95-9924-4e5f81c1e96a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1281 microversion: 2.20 time: 0.376214 Sep 26 17:57:47.771460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 29/49] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:47 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1281 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:47.776324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e6744734-03d7-460a-9a93-2c569c017934 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:47.777238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e6744734-03d7-460a-9a93-2c569c017934 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:47.815096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.826760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c867820e-3848-4ff5-bfea-d4b6f7c5d5b1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1279 microversion: 2.1 time: 0.228323 Sep 26 17:57:47.837323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 21/50] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:47 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:47.920700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e6744734-03d7-460a-9a93-2c569c017934 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:47.928628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e6744734-03d7-460a-9a93-2c569c017934 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1241 microversion: 2.1 time: 0.155999 Sep 26 17:57:47.932292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 30/51] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:47 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1241 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:48.422797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:48.433050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad9fb3e-9580-4855-bd01-23c73ebc5697", "tag": "df1af5ff-3f2c-4a25-b273-3c032923423a"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:48.435952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:48.452319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.453895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.456818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.457520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.457729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.458577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.458841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.459403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.460111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.489267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Creating event network-changed:df1af5ff-3f2c-4a25-b273-3c032923423a for instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 on hv-cinder-85931 Sep 26 17:57:48.510392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 17:57:48.510392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8e561490-7bcc-440a-94c1-754962631220 req-4a19342c-ef88-49f2-8fc8-4afc975a34c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 17:57:48.510392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.510392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.510392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.510746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.510746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.524019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.542032 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.compute.rpcapi [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 17:57:48.546792 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] Releasing lock "compute-rpcapi-router" {{(pid=132948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 17:57:48.574443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1e9d6bfb-8d59-4773-83d7-446e5667dca1 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229638 Sep 26 17:57:48.575057 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 22/52] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:48.786266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-269170710", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7327a67e-44b9-426d-af9d-05e96c87ac54"}], "security_groups": [{"name": "tempest-securitygroup--2105853133"}], "key_name": "tempest-keypair-86825364", "user_data": "}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:48.942085 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:48.950729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6345f743-ec32-4019-95ed-ba9255a39e4f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.535773 Sep 26 17:57:48.953393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 31/53] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:48 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:48.966983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:48.967618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:48.979310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] validate_networks() for [('7327a67e-44b9-426d-af9d-05e96c87ac54', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:57:48.984528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.985010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.985948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:48.988726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:48.989612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:48.990498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.095792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:49.105645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:49.107379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:49.108536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-35485c3d-dc00-4ea5-a049-25a9fc6c4c98 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1285 microversion: 2.20 time: 0.153291 Sep 26 17:57:49.114991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 32/54] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:48 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:49.122125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:49.123024 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:49.131498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.132071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.132590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.133445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.134101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.134750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.405366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:49.428558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0f297f89-29b2-40ab-ab38-683fd3daa8a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.312141 Sep 26 17:57:49.432469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 33/55] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:49 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:49.443585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:49.447526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:49.472577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.474508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.476921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.481631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.482369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.482949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.636138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:49.647476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1514a89d-cc56-4c33-aeb5-a9b3972d331b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1245 microversion: 2.1 time: 0.213776 Sep 26 17:57:49.679687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 34/56] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:49 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1245 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:49.679882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:57:49.679882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:57:49.679882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:57:49.679882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:57:49.679882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:57:49.691877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.695969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.699369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.700849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.701354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.701784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:49.735665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:57:49.740339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for user 2020860051d44960a924b62989a7988b and project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:57:49.746033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:49.756666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:57:49.759564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:57:49.979059 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:49.980179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:49.997703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:49.998555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:49.999210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.000156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.000817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.001565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.136129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a94b26f2-8515-4a79-9334-d8429badfdb8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.355020 Sep 26 17:57:50.147170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 23/57] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:57:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 17:57:50.165427 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:50.165427 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:50.200626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.202172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.204117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.209111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.209908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.211354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.319697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.333643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0ed1c8c7-f048-4708-be0f-1ef58dbd29a1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.360920 Sep 26 17:57:50.334240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 35/58] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:49 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:50.340387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1f157162-17fb-453e-b79a-888ac3a0a623 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:50.342031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1f157162-17fb-453e-b79a-888ac3a0a623 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:50.421074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.432768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.436766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.443481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b2be5ae4-24e8-4fd8-b51b-a5547896a91e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1285 microversion: 2.20 time: 0.291622 Sep 26 17:57:50.460696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 24/59] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:50 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1285 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:50.466050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:50.485583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:50.506163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.508229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.511465 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.514607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.519476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.524207 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.540530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1f157162-17fb-453e-b79a-888ac3a0a623 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.552462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1f157162-17fb-453e-b79a-888ac3a0a623 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1235 microversion: 2.1 time: 0.216106 Sep 26 17:57:50.555234 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 36/60] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:50 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1235 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:50.686377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:50.687052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:50.700565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.701568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.702432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.707166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:50.708694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:50.717153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:50.976609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:50.987676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f38ce4a1-afdc-4bff-a523-ead62a6cc219 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1245 microversion: 2.1 time: 0.303078 Sep 26 17:57:50.988298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 37/61] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:50 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1245 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:51.107280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.118464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d089c689-343a-4b76-90d8-cb0e2146d815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.656414 Sep 26 17:57:51.119059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 25/62] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:50 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:51.358057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:51.361562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:51.365773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:51.366466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:51.367075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:51.367937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:51.368541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:51.369116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:51.469965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:51.471072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:51.498230 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:51.498914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:51.499502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:51.500386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:51.501568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:51.502174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:51.733542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.733542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-19ea7f51-348c-4bcc-b3a2-15c6204c12e1 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.377095 Sep 26 17:57:51.733542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 38/63] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:51 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:51.773205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-07532aba-28a6-4002-bb16-374c543690f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:51.773864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-07532aba-28a6-4002-bb16-374c543690f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:51.814412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:51.841553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.858238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.865655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.869045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6689ddf5-9fc1-4d85-8e64-a1ab7b8905f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1333 microversion: 2.20 time: 0.402952 Sep 26 17:57:51.877361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 26/64] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:51 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1333 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:57:51.937057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-07532aba-28a6-4002-bb16-374c543690f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:51.954289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-07532aba-28a6-4002-bb16-374c543690f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1235 microversion: 2.1 time: 0.221470 Sep 26 17:57:51.955522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 39/65] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:51 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1235 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:52.013609 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:52.015006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:52.021683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.022177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.022615 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.023318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.023778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.024208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.145675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:52.146677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:52.159467 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.159957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.160389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.161088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.161763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.163360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.177361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:52.211429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-05b4127c-e908-43fa-b8b0-3f426f4f1d37 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1237 microversion: 2.1 time: 0.198695 Sep 26 17:57:52.211429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 27/66] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:52 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:52.499918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:52.508214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-52459121-d304-44c4-9c9c-6f116204c67b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.366274 Sep 26 17:57:52.528261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 40/67] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:52 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:52.758663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:52.759867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:52.771185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.771185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.771185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.771185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.771479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.771479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.913307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:52.918162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:52.948143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.948694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.949042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:52.956544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:52.957029 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:52.957483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.100137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.110164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.122614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.124495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d17394ef-9b6a-4fc8-8976-68a2b25d4293 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1333 microversion: 2.20 time: 0.228225 Sep 26 17:57:53.131634 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 41/68] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:52 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1333 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:53.138841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:53.143314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:53.156257 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.161286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.162061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.163475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.164214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.164830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.212049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.237051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-84098187-8b1a-4630-98af-47e304c97ed4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.483257 Sep 26 17:57:53.243725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 28/69] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:52 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:53.257803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:53.258646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:53.323321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.323321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.323321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.323321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.323601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.323601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.323728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.323728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-762c1d85-1d70-48ae-810f-a4a19a0db51a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1239 microversion: 2.1 time: 0.158384 Sep 26 17:57:53.323728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 42/70] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:53 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1239 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:53.348198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.359869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b6363f08-c719-4cdf-8103-7d98cdecd43c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1237 microversion: 2.1 time: 0.109439 Sep 26 17:57:53.360959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 29/71] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:53 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:53.535984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:53.536671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:53.546095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.546582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.547013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.556142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:53.556693 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:53.557135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:53.824491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:53.852228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5a528398-feb8-4f0d-89ed-18291892796d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.319211 Sep 26 17:57:53.867319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 43/72] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:53 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:54.013099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a4239-37d1-4a0d-8d9d-35f96f93f7c1", "tag": "d5c7742a-1615-4abe-a98f-3a8de2bdf219"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:54.019045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b915bd-9baa-4915-861d-b2d2916f390f", "tag": "1c747281-9d9d-4183-b4f2-a9beb65a911f"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:57:54.038573 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.039059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.042399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.066132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.066621 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.067058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.068597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] Creating event network-changed:d5c7742a-1615-4abe-a98f-3a8de2bdf219 for instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 on hv-cinder-85931 Sep 26 17:57:54.093009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-945cdc90-9366-44ad-9ab4-8552ca645f55 req-3e1170e7-db77-407e-b972-1d4f1541c942 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209820 Sep 26 17:57:54.093940 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 30/73] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:54.109809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Creating event network-changed:1c747281-9d9d-4183-b4f2-a9beb65a911f for instance 39b915bd-9baa-4915-861d-b2d2916f390f on hv-cinder-85931 Sep 26 17:57:54.111707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 17:57:54.112289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-1b2bbd69-9df1-4bf7-baae-175578561299 req-4c2f9fa7-c430-4219-b01d-5040f66f551b service nova] Acquired lock "compute-rpcapi-router" {{(pid=132949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 17:57:54.114057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.114896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.115196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.115939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.117089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.117520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.128210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:54.130495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.compute.rpcapi [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 17:57:54.132442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=132949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 17:57:54.156992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:54.160150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-839c46f7-66df-48bb-8fc6-e263e21016c2 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143797 Sep 26 17:57:54.161885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 44/74] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:54.165532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:54.175241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.175960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.176565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.177445 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.177898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.178450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.268767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:54.269502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:54.275883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.278977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.278977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.278977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.278977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.279376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.279452 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.302491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.304036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.314714 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eb3f3abd-6605-4224-ab5f-783308b72d57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1341 microversion: 2.20 time: 0.155190 Sep 26 17:57:54.319104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 31/75] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:54 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:54.338772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:54.339673 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:54.348817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.349863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.350623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.359942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.362610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.363407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.457381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.468174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d001d83a-1370-40bf-bf47-1383265a450c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1231 microversion: 2.1 time: 0.150902 Sep 26 17:57:54.468927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 32/76] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:54 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1231 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:54.474602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:54.481539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:54.499880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.500856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.501678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.502679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.503361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.503997 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.550917 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.559594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-77e0cee8-4a9e-451c-9b47-9d6d7e99b9db tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.295029 Sep 26 17:57:54.560181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 45/77] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:54 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:54.594492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:54.608243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e4cfbb30-77f8-4286-b6d3-7c75a4daca49 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1293 microversion: 2.1 time: 0.137976 Sep 26 17:57:54.609438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 33/78] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:54 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:54.888290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:54.888991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:54.896101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.896697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.897543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:54.902296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:54.902296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:54.902296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.072438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.082220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4752f85e-e992-4b37-b0fb-e6d4deb49462 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.197655 Sep 26 17:57:55.082795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 46/79] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:54 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:55.352129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:55.353450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:55.361471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.362134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.362566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.363446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.364035 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.364680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.449588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.458388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.459845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.461062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6c9153a7-75c3-4521-8e96-ee8e3145c3ac tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1341 microversion: 2.20 time: 0.118603 Sep 26 17:57:55.461796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 34/80] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:55 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1341 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:55.496055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:55.497306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:55.504697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.505141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.505619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.506315 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.506827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.507247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.585005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:55.586036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:55.596355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.597403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.597944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.599078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.599881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.600530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.628383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:55.750313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.768265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-18052595-ac88-4277-93bf-4e5a47b1fa7d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1231 microversion: 2.1 time: 0.274985 Sep 26 17:57:55.769144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 47/81] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:55 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1231 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:55.789361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:55.790351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:55.798686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.799450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.800158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.801081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:55.801591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:55.802019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:55.884247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.897788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0fe254cd-34cd-4dc4-a3f3-cc15073d6292 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1293 microversion: 2.1 time: 0.125762 Sep 26 17:57:55.901462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 48/82] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:55 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:55.951457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:55.962137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ab5e610f-5ae1-493b-aa5e-aebb6c841d3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.382365 Sep 26 17:57:55.977250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 35/83] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:55 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:56.107345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:56.108745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:56.118201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.118909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.119343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.120112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.120728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.121184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.293106 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:56.301365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-54a6663c-08f4-42e5-97b1-39388130777b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.198458 Sep 26 17:57:56.306733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 49/84] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:56 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:56.489074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:56.490215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:56.496218 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.496698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.497125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.498011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.498461 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.498889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.562402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:56.570443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:56.571888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:56.572975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5571420a-5952-4eee-ba78-24c003f09908 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1341 microversion: 2.20 time: 0.088502 Sep 26 17:57:56.573555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 36/85] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:56 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:56.799476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:56.800092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:56.807805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.808387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.808876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.809597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.810098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.810463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.874108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:56.882240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5b0100e7-0fbf-4e2d-826f-8c9ba3cf645b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1231 microversion: 2.1 time: 0.088609 Sep 26 17:57:56.882808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 50/86] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:56 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:56.921113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:56.921770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:56.927602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.928079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.928515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.929206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:56.929686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:56.930111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:56.996215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:56.996550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:57.006071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.006736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.008611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.008611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.008611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.008998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.052522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.065518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f7788288-f582-47c9-bf2b-6eb43e13bdf5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1293 microversion: 2.1 time: 0.147388 Sep 26 17:57:57.066653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 37/87] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:56 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:57.251516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.274155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-395cdda6-4288-452d-87a1-29542974eee4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.281923 Sep 26 17:57:57.285312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 51/88] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:56 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:57.324940 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:57.325592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:57.332105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.332579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.333045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.333757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.335499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.335815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.477446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.487030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4123abb8-974a-428f-98cc-520454473993 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.166772 Sep 26 17:57:57.487774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 38/89] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:57 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:57.597839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:57.598367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:57.604273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.604741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.605170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.605866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.606309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.606722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.672370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.681009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.682518 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.683593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-533cef10-e9d9-4f11-b67f-d810d3fddc9d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1351 microversion: 2.20 time: 0.089803 Sep 26 17:57:57.684138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 52/90] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:57 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:57.905486 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:57.916112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:57.916112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.916112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.916112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.922217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:57.922217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:57.922217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:57.981030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:57.992190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1653982d-938d-41d6-81ed-ece46ebfdfb5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1231 microversion: 2.1 time: 0.090628 Sep 26 17:57:57.992757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 39/91] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:57 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:58.097316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:58.097932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:58.103885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.104366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.104881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.105601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.106069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.107757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.173629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.181930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f6225980-bda6-422e-bd10-3263b2cefc56 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1293 microversion: 2.1 time: 0.088958 Sep 26 17:57:58.182663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 53/92] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:58 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:58.296953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:58.298325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:58.303640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.304118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.304554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.305252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.305712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.306249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.513036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:58.513865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:58.527698 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.530109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.531030 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.532896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.545905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.555512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.762467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.771152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e6e22740-531d-4f7d-9516-3dacd7a5652f tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.477812 Sep 26 17:57:58.772979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 40/93] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:58 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:58.777324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:58.778108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:58.785526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.786381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.787142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.788167 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:58.788801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:58.789441 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:58.895215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.903406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.905106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.906521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ca1dc53b-4f34-41ce-aaef-6fcd95fd6ddd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1339 microversion: 2.20 time: 0.133874 Sep 26 17:57:58.921620 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 41/94] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:58 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:58.930793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:58.940449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cba7c6c9-d2bf-4f96-8aef-70e8fb5b65c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.432562 Sep 26 17:57:58.942572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 54/95] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:58 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:59.016134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:59.016825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:59.023587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.024372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.024865 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.025836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.026353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.026847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.150704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:59.161291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-425bb840-cce4-474e-9d53-5f074e081b51 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1231 microversion: 2.1 time: 0.149026 Sep 26 17:57:59.161866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 42/96] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:59 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1231 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:59.206602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:59.207273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:59.213877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.214560 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.215219 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.216239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.217445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.218043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.293764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:57:59.302607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4f744751-e36a-4d3e-8050-494d397d6d54 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1293 microversion: 2.1 time: 0.100202 Sep 26 17:57:59.303183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 55/97] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:59 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:59.807773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:59.809988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:59.821551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=6 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:59.824701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=34 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:59.826437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.827140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.827809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.831779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.832464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.833156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.932809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:59.933597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:57:59.940617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.941210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.941779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:57:59.943044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:57:59.943744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:57:59.943861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.034171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.045005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a1def4f5-b0cb-4e13-bc28-5d40daedab37 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.248829 Sep 26 17:58:00.046629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 43/98] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:57:59 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:00.052103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:00.052966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:00.082587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.084298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.084757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.085499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.085972 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.086400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.155818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.164608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.166060 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.167234 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-417cb616-b0df-49de-b7d6-70e7ffc6fba8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.238842 Sep 26 17:58:00.167761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 56/99] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:57:59 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:00.187724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:00.188489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:00.198405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.200258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.200258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.200956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.201498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.201938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.265124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.274915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8f3c9a4d-e0f7-4be0-bf24-7d5153369bc4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.226802 Sep 26 17:58:00.289246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 44/100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:00 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:00.289448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.296281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-83c880ec-6d75-45e0-b1a9-34460239ce7b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1287 microversion: 2.1 time: 0.112396 Sep 26 17:58:00.296934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 57/101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:00 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:00.326913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:00.327523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:00.333355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.333829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.334257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.334930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:00.335405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:00.335824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:00.395915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:00.403394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-35232a61-9393-48cc-b253-97ff76ceb3f3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1301 microversion: 2.1 time: 0.080294 Sep 26 17:58:00.403959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 45/102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:00 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:01.074822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:01.074822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:01.078426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.079016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.080229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.081517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.082188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.082920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.193335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:01.193990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:01.199965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.200441 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.200881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.201591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.202074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.202492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.216938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.240156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dfd07326-d513-40a2-8f36-57c0087114ef tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.175067 Sep 26 17:58:01.240743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 58/103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:01 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:01.300268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:01.301318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:01.310976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.310976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.310976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.310976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.311326 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.311738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.369145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.385730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.388266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.389507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-03c8482d-7147-4a62-bf78-19f5ad245b82 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.200995 Sep 26 17:58:01.391112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 46/104] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:01 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:58:01.396980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:01.398649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:01.409521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.409521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.409521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.409521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.409836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.409836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.487013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.494262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.494704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-017016c3-5e32-4084-93a5-45a3a5ddcf02 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1287 microversion: 2.1 time: 0.102242 Sep 26 17:58:01.495281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 47/105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:01 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:01.500249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:01.501435 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:01.504753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f59826ca-dbeb-4394-bcf4-84ca2d4a0e3e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.209159 Sep 26 17:58:01.505424 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 59/106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:01 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:01.512744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.512744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.512744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.512744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:01.513174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:01.513174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:01.577546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:01.585360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0dd41cd8-8159-4612-b867-debfa8259014 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1301 microversion: 2.1 time: 0.089093 Sep 26 17:58:01.585930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 48/107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:01 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:02.265394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:02.266038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:02.267991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=32 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:02.273337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.274217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.274864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.275567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.276080 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.276460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.419422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:02.420569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:02.436010 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.436705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.437301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.438027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.438514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.438937 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.449458 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:02.462263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-10f76a10-6d4c-41b5-8e6c-768ea5c77a5c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.199795 Sep 26 17:58:02.468933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 60/108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:02 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:02.518308 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:02.519056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:02.534795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.541607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.548285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.550422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.550893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.551333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.584017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:02.718536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:02.734013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6fba9924-6aa8-484d-a192-6ad0fbc31d93 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1287 microversion: 2.1 time: 0.219636 Sep 26 17:58:02.736991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 61/109] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:02 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1287 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:02.747649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:02.749429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:02.761317 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.762114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.762767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.765447 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.766138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.767302 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.771392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:02.785773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:02.787342 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:02.792327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6111d647-606d-4c48-b63e-e7334ff7be7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.376025 Sep 26 17:58:02.808139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 49/110] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:02 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:02.808139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:02.808139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:02.823424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.829674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.833553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:02.834668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:02.835386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:02.836003 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:03.077893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:03.086394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a6e0726e-7cd3-4c6f-ad27-da62dfe23105 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1301 microversion: 2.1 time: 0.289041 Sep 26 17:58:03.102268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 50/111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:02 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1301 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:03.133860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:03.146926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8ea3c3ea-0965-45c0-a0ca-ec3dedf7b176 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.407683 Sep 26 17:58:03.148453 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 62/112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:02 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:03.488344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:03.488934 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:03.500075 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:03.500605 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:03.501718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:03.502750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:03.503205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:03.504137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:03.759514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:03.760323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:03.770216 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:03.771041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:03.772953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:03.779224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:03.779987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:03.781893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:03.965197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:03.979158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2bcdbca9-a8e9-45c2-871b-0c2b578a827d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1295 microversion: 2.1 time: 0.222165 Sep 26 17:58:03.981026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 63/113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:03 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1295 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:03.990932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:03.991716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:04.000042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.001214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.001812 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.002807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.003388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.003948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.009759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:04.027739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a34e12f1-a473-4d32-b93a-05501a23b73d tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.543409 Sep 26 17:58:04.031504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 51/114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:03 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:04.112513 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:04.113296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:04.120077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.120553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.127758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.127758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.127758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.127758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.128182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=8 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:04.128335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:04.390464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:04.403289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-43bb2f35-39db-438b-b7ba-6d284f9f3323 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1311 microversion: 2.1 time: 0.296728 Sep 26 17:58:04.406162 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 52/115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:04 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:04.421348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:04.422367 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:04.433612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.434390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.434983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.435837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.436433 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.437011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.449276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:04.504891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:04.509621 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:04.513355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7e59a253-669e-46dd-af4b-f68fd3c67800 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.528620 Sep 26 17:58:04.519654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 64/116] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:03 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:04.595040 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:04.609033 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:04.609567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:04.610023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:04.621707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] Creating event network-changed:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 17:58:04.627536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-635a843a-4711-4b82-ae30-8d9aefec82e2 req-867903be-fbf7-4cd6-be2d-510391b791cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036149 Sep 26 17:58:04.631287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 65/117] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:04.990068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:05.020908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-55d61ff6-ab34-4d5b-bdc5-772b851c50ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.610149 Sep 26 17:58:05.022908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 53/118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:04 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:05.030762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:05.031383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:05.037704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.066165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.066729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.070543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.071053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.071518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.118937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad9fb3e-9580-4855-bd01-23c73ebc5697", "name": "network-vif-plugged", "status": "completed", "tag": "df1af5ff-3f2c-4a25-b273-3c032923423a"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:05.131945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.138137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.138137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.181315 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] Creating event network-vif-plugged:df1af5ff-3f2c-4a25-b273-3c032923423a for instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 on hv-cinder-85931 Sep 26 17:58:05.199859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-d80dc4f4-0141-4c9d-be3d-9e52dfb12f71 req-cc745d1c-16c9-481c-abea-cf82d8c6dfe9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239218 Sep 26 17:58:05.201039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 66/119] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:05.212019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:05.213494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:05.226442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.227282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.227930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.228854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.229544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.230193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.377193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:05.385361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9f8adc07-23fa-4b30-9d34-094cae24dac6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1293 microversion: 2.1 time: 0.361224 Sep 26 17:58:05.401435 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 54/120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:05 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1293 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:05.435848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:05.436695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:05.448572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.449072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.452312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.453328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.453971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.455099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.561109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:05.569791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-823d65bc-a045-458a-9140-14560982a7ba tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1299 microversion: 2.1 time: 0.138119 Sep 26 17:58:05.570869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 55/121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:05 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:05.575789 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:05.576478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:05.583038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.583589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.584478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:05.585182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:05.585754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:05.586380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.104876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.120282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-eb25d1ae-9484-4297-841c-c41bb6017d04 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.911822 Sep 26 17:58:06.121026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 67/122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:05 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:06.125877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:06.126491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:06.143388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.143889 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.147093 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.147844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.148319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.148752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.355368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.398075 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.399685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.407823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-52c0a609-8659-4729-be5a-55980c45197a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.834642 Sep 26 17:58:06.413274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 56/123] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:05 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:06.431155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:06.432265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:06.442945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.443436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.444072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.444770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.445259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.445923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.686870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.711379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bd71be9b-b0f8-4dcc-88a2-0c7472c917fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.589039 Sep 26 17:58:06.716113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 68/124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:06 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:06.730321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:06.731286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:06.743132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.743999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.744632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.747967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:06.747967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:06.747967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:06.775018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.787149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1f579a43-b8e6-4480-a6d0-f80b1b17f3d6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.375175 Sep 26 17:58:06.788100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 57/125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:06 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:06.962317 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:06.971998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d8a5de30-f653-4d11-a5c9-059d1ce00ede tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.254788 Sep 26 17:58:06.973041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 69/126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:06 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:07.144110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:07.144710 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:07.150575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.151055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.151489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.152185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.152628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.153045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.275162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4239-37d1-4a0d-8d9d-35f96f93f7c1", "name": "network-vif-plugged", "status": "completed", "tag": "d5c7742a-1615-4abe-a98f-3a8de2bdf219"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:07.286218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.286837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.287366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.304025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] Creating event network-vif-plugged:d5c7742a-1615-4abe-a98f-3a8de2bdf219 for instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 on hv-cinder-85931 Sep 26 17:58:07.305159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-50dc20ff-9bc2-46f8-adee-9258c52d00c8 req-0ff3f0cb-9cde-48e8-83ff-51c02a21de61 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Sep 26 17:58:07.306204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 70/127] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:07.405834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:07.418013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ad756639-9215-4765-a5ce-ef6ec20dcc3b tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.277727 Sep 26 17:58:07.433249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 58/128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:07 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:07.440320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:07.441347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:07.451489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.451988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.455032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.455032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.455032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.455032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.676607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:07.685674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:07.687630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:07.689528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9388e87e-ea9e-4499-b9a0-e6481a284705 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.254263 Sep 26 17:58:07.690496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 71/129] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:07 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:07.743622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:07.744198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:07.756485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.757252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.763178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.763178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.763178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.763178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.812465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:07.813384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:07.820504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.821207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.822540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:07.823401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:07.824003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:07.824574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.014869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.024407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-443fce2d-fee2-43da-908a-68f8f4878ef4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.288128 Sep 26 17:58:08.025250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 59/130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:07 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:08.038085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:08.046420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:08.048156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.056521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f62aa60e-0393-4f93-82e9-ddb502a790e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.247960 Sep 26 17:58:08.063737 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.064262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.064739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.065479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.065972 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.066403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.072247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 72/131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:07 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:08.197008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.205186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3cf098c8-edad-4674-be01-4061a84b7a03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.178843 Sep 26 17:58:08.217680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 60/132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:08 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:08.255291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158e230e-aa1a-4311-81fc-5815c8cf0f64", "tag": "dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:08.267042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.267755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.268544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.281780 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] Creating event network-changed:dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a for instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 on hv-cinder-85931 Sep 26 17:58:08.287304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-4e3fc6ae-9a62-4c49-b651-402980aa13b6 req-8ddab2bf-2fc6-4cd5-9149-df8016a21c91 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035932 Sep 26 17:58:08.288136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 73/133] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:08.442380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:08.443026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:08.449994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.450465 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.450905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.451879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.452346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.452777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.638242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.654832 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0b45cdb9-f7bc-4fff-8d62-3230b61df345 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1315 microversion: 2.1 time: 0.217107 Sep 26 17:58:08.655774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 61/134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:08 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:08.715741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:08.716725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:08.722962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.723629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.724229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.724915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:08.727961 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:08.728424 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:08.880077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.888055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.889521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:08.890615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-da1a43b0-54fa-46f2-bf7b-000672d13314 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.179354 Sep 26 17:58:08.891197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 74/135] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:08 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:09.048285 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:09.048920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:09.054756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.055232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.055657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.056339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.056779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.057193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.079724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:09.080666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:09.088983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.089555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.090163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.090920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.091396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.092002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.261082 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:09.271691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e823c5c8-8df0-419a-af0f-9e21ac267f3c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.227675 Sep 26 17:58:09.275380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 62/136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:09 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:09.290041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:09.291726 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:09.299137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.299626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.300100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.300862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.301379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.301845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.303164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:09.310979 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b6772558-f25e-4b1b-b8a9-cba9b929c65e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.235488 Sep 26 17:58:09.311686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 75/137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:09 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:09.329713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b915bd-9baa-4915-861d-b2d2916f390f", "name": "network-vif-plugged", "status": "completed", "tag": "1c747281-9d9d-4183-b4f2-a9beb65a911f"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:09.342991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.343575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.344003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.355950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] Creating event network-vif-plugged:1c747281-9d9d-4183-b4f2-a9beb65a911f for instance 39b915bd-9baa-4915-861d-b2d2916f390f on hv-cinder-85931 Sep 26 17:58:09.361477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-7e6d3102-4766-483c-9e94-847f03ba8a99 req-b0da2404-9518-4925-bb00-84e216888f64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037446 Sep 26 17:58:09.362082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 76/138] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:09.440193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:09.447976 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0aa85e16-8907-447a-a346-bbf38b109dcf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.171458 Sep 26 17:58:09.460336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 63/139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:09 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:09.682377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:09.683082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:09.691944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.692492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.693131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.694051 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.694726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.695214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.863327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:09.871164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-91d858ef-56e6-47d4-89d9-cdfa713c0150 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1501 microversion: 2.1 time: 0.192948 Sep 26 17:58:09.871723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 77/140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:09 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:09.917183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:09.917821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:09.924140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.924676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.925064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:09.925806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:09.926257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:09.926869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.052715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.060798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.062270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.064085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ab3c094f-0a60-437b-aff0-0a6b71b7bc85 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.150704 Sep 26 17:58:10.064524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 64/141] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:09 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:10.295897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:10.296579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:10.304103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.305490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.306133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.306843 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.307306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.307732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.307831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b533dfe6-6158-43f2-961d-f50d398f79d6", "tag": "35e30149-7490-417a-a493-6bef261bb382"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:10.322117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.322709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.323143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.337168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] Creating event network-changed:35e30149-7490-417a-a493-6bef261bb382 for instance b533dfe6-6158-43f2-961d-f50d398f79d6 on hv-cinder-85931 Sep 26 17:58:10.343388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-b4c299b9-7e6d-4571-8c8b-263eeedf7d1a req-68b9b4f0-f2a2-4436-b3a7-998847634a6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039656 Sep 26 17:58:10.354105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 65/142] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:10.372007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:10.384241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:10.396857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.397375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.406806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.406806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.406806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.406806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.573091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.583903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dad88295-255c-4026-bac4-44c3300fbe8e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.291934 Sep 26 17:58:10.597791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 78/143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:10 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:10.602957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:10.603566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:10.609596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.610631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.611058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.611739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:10.612178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:10.612733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:10.619452 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.627344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-38e8ea0e-fe92-43cb-951c-cf90f0a78a54 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.264801 Sep 26 17:58:10.627908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 66/144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:10 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:10.767469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:10.779497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bd39ae7d-1b5e-4c2c-99d8-4f222c4f0e6b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.180284 Sep 26 17:58:10.781339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 79/145] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:10 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:11.090043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:11.090790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:11.097880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.105264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.105264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.105264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.105264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.105855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.233554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.241634 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.243118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.244541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dcbaef38-3d37-48d5-abcc-2cc594296629 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.158686 Sep 26 17:58:11.245099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 67/146] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:11 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:11.611090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:11.611736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:11.617627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.618119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.618564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.619250 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.619707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.620130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.651417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:11.652182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:11.658635 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.659199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.659704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.660464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.661027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.661515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.810556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.819022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fa82f0fb-57b1-4d3c-92ec-6f3079c027a5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.211709 Sep 26 17:58:11.819799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 80/147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:11 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:11.824211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:11.825181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:11.831506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.832042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.832653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.833362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:11.833812 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:11.834230 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:11.841592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.845587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-be894b96-b1e9-4ddb-b894-d04e3f7970db tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.197979 Sep 26 17:58:11.846147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 68/148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:11 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:11.862034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:11.971206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:11.985363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bf8416a3-bfae-46e0-86e3-a17dcc8b789e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.159185 Sep 26 17:58:11.985363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 81/149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:11 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:12.148559 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86dfdcfa-7d63-4a2a-ac8d-87b9cc4d8fa4"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:12.151205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:12.157761 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.158248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.158813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.159466 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.159885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.160302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.217101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:12.270767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:12.271791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:12.281337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.283337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.283969 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.285084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.285750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.286366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.421892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:12.427888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:12.429369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:12.430471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fcc4f0c0-0984-4536-b5ed-57058e65ac83 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.164887 Sep 26 17:58:12.431025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 82/150] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:12 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:12.445539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "name": "network-vif-plugged", "status": "completed", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:12.445539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.445539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.445764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.459526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] Creating event network-vif-plugged:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 17:58:12.464835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-be752c41-a579-48aa-b5d8-5c5caf3394ed req-a3f7fd52-c720-425e-bb3c-8a43d5e4ea85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Sep 26 17:58:12.465562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 83/151] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:12.849428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:12.850284 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:12.856815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.857355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.857791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.858516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:12.858965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:12.859387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:12.990193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:12.998121 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f08dd7fa-5ef8-42c6-96f7-ccbae98b864f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.152819 Sep 26 17:58:12.998799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 84/152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:12 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:13.004564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:13.005164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:13.011164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.011637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.012064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.012739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.013182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.013744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.148250 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:13.156595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7f2176de-cd3a-46b6-aae2-eb429d5945e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.156822 Sep 26 17:58:13.157166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 85/153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:12 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:13.173047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:13.173693 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:13.180361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.180361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.180680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.181154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.181638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.182062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.322635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:13.330912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cee19954-b323-460d-b79d-9c34d8ac1289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.161684 Sep 26 17:58:13.331586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 86/154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:13 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:13.459163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:13.459767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:13.465749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.466157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.466610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.467297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:13.467749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:13.468164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:13.598422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:13.606462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:13.608220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:13.609380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e740f17e-27ff-473f-beb9-e4d314c46849 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.154481 Sep 26 17:58:13.610709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 87/155] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:13 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:58:14.028144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:14.028764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:14.039790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-78716863-5209-4ded-be01-8bdd9f322c42 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "POST /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.894945 Sep 26 17:58:14.045893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 69/156] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 17:58:12 2022] POST /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697/os-volume_attachments => generated 194 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:14.046013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.046013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.046013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.046013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.046338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.046338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.173725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.179872 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:14.180568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:14.181822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-382c4feb-afa4-4a18-8524-456e9a9ffc96 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.157653 Sep 26 17:58:14.182431 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 88/157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:14 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:14.183670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:14.187318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.187791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.188213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.188893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.189364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.189845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.317059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.324739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6a79c05d-e124-41dd-bb5f-6c0d68debed8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.148997 Sep 26 17:58:14.325321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 70/158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:14 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:14.352994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:14.353629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:14.356731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:14.360049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.360526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.361010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.361712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.362160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.362581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.494092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.501823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1a1d4453-859b-4ac1-af7a-553117820122 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.152760 Sep 26 17:58:14.502481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 89/159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:14 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:14.635704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:14.636338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:14.642671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.643171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.644420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.644420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:14.644749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:14.645164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:14.774198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.783723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.785172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:14.786315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-de5c1530-e0a6-45d4-9dd9-0d441d2dc04f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.154583 Sep 26 17:58:14.786871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 71/160] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:14 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:15.205300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:15.205908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:15.212036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.212514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.212943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.213652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.214099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.214518 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.341177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:15.348097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:15.348707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:15.348865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c447d428-f721-4e8c-837b-8148e7d3956c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.147983 Sep 26 17:58:15.349465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 90/161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:15 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:15.355052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.355651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.356021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.356702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.357152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.357602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.485242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:15.492824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8ac2db1f-4e4b-45a3-9aa8-530416c25b1b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.148763 Sep 26 17:58:15.493396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 72/162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:15 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:15.524119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:15.524746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:15.530912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.531385 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.531807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.532490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.532936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.533393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.659223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:15.667230 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-74b81eab-9eaa-4f0e-bdd5-424238a833f9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.147138 Sep 26 17:58:15.667793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 91/163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:15 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:15.811256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:15.811882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:15.819444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.819917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.820342 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:15.821050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:15.821517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:15.821928 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.149735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.158017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.159460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.160553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1f4c18ea-6d8f-47b6-a6e5-ee3ac70d4fe0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.353220 Sep 26 17:58:16.161153 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 73/164] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:15 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:16.372412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:16.372955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:16.379742 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.380228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.380666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.381384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.381840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.382268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.507428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.515400 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c4db9c1a-2eb6-4024-8ec2-373405f19cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1321 microversion: 2.1 time: 0.146893 Sep 26 17:58:16.515960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 92/165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:16 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:16.518633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:16.519240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:16.525154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.525664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.526086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.526798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.528601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.529021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.657923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.665794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dd9b2ad0-ef02-4fb6-89a9-4012488cc7be tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.151469 Sep 26 17:58:16.666366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 74/166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:16 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:16.689786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:16.690393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:16.696320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.696803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.697269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.697957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:16.698457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:16.698878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:16.826708 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:16.835007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8b3f76f0-a5f3-48b1-a874-e3ba472c3268 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.149135 Sep 26 17:58:16.835573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 93/167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:16 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:17.185321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:17.185964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:17.192697 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.193240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.193678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.194358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.194954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.195376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.326220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:17.334974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:17.336421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:17.337600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dc0bef40-deba-4ea8-a746-82e85317863e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.156209 Sep 26 17:58:17.338186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 75/168] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:17 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:17.538095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:17.538700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:17.544771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.545278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.545720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.546431 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.546885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.547311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.676919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:17.686576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7fb4684f-aa82-4255-b19e-14650ac68e97 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1516 microversion: 2.1 time: 0.152355 Sep 26 17:58:17.687188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 94/169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:17 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:17.690831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:17.691444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:17.697549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.698124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.698881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.699735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.700323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.700895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.712439 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:17.714304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:17.722567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.723370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.724229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.725697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.727270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.727895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.794955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'flavor' on Instance uuid 39b915bd-9baa-4915-861d-b2d2916f390f {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:58:17.851416 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:17.860575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ee06f6b0-0b17-4eb4-b7c2-2d24c5828ead tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.175169 Sep 26 17:58:17.861403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 76/170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:17 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:17.877604 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:17.878212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:17.888327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.888875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.889426 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:17.890182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:17.890668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:17.891083 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.038531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:18.046132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-228fd6d1-f468-485b-a049-6f37d1f541f2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.179398 Sep 26 17:58:18.046683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 77/171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:17 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:18.196472 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6d5cb442-230b-4a0d-a03c-086fe5099102 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f/action" status: 200 len: 32 microversion: 2.1 time: 0.489179 Sep 26 17:58:18.197128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 95/172] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 17:58:17 2022] POST /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 17:58:18.206555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:18.207201 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:18.213567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.213981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.214409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.215081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.215526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.215939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.346667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:18.361981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3bf74542-2326-441c-bcc7-ad8c413ca344 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.158643 Sep 26 17:58:18.362996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 78/173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:18 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:18.368042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:18.369193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:18.377342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.377835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.378267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.378981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.379419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.379844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.511357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:18.515097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:18.520657 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:18.522188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:18.523286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c3cede1b-c7ee-48ff-8d48-94992d02eae0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.164064 Sep 26 17:58:18.523841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 96/174] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:18 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:18.883910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:18.884526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:18.890685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.891164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.892231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:18.892947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:18.893437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:18.893865 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.018770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.026490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c17459e7-95d2-4556-bbbe-a0edc63db4a1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.146503 Sep 26 17:58:19.027049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 79/175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:18 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:19.069092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:19.069762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:19.076433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.076868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.077324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.078011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.078458 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.078878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.208061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.215467 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6346f6ea-3411-43ed-8afd-08fbe34c255d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.150571 Sep 26 17:58:19.216020 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 97/176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:19 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:19.386247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:19.386775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:19.393355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.393845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.394286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.395022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.395479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.395904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.523491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.531501 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5531368b-357b-4f9f-869e-281a04b63d56 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.149146 Sep 26 17:58:19.532104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 80/177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:19 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:19.549823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:19.550442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:19.556972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.557479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.557912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.558595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:19.559048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:19.559470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:19.688073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.696185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.697669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:19.698815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cc5ac3f6-1179-471b-a177-e4d49a295ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.153490 Sep 26 17:58:19.699373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 98/178] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:19 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:20.049165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:20.049886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:20.055739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.056215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.056646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.057356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.057860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.058280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.188594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.196346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-68f8afdb-6a11-454f-b7fe-c7b3a959fcfa tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.150863 Sep 26 17:58:20.196759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 81/179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:20 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:20.237183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:20.237807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:20.244199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.244674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.245105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.245808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.246254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.246675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.372580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.381025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a2b99c33-63b8-41e0-9bc0-3ff8e5ec4402 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.147663 Sep 26 17:58:20.381617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 99/180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:20 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:20.555592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:20.556203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:20.562588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.563068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.563503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.564203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.565168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.565611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.699422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.706958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bdcc9918-5410-4314-8a20-87d6955a69d9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.155325 Sep 26 17:58:20.707521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 82/181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:20 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:20.723641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:20.724244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:20.730179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.730653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.731115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.731792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.732241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.732664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.871811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b533dfe6-6158-43f2-961d-f50d398f79d6", "name": "network-vif-plugged", "status": "completed", "tag": "35e30149-7490-417a-a493-6bef261bb382"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:20.879493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.884431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:20.885468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:20.886134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:20.889175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.892025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:20.893162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-df05ec70-60df-4f2b-b446-07c409d3947a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.173510 Sep 26 17:58:20.894199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 100/182] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:20 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:20.898316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] Creating event network-vif-plugged:35e30149-7490-417a-a493-6bef261bb382 for instance b533dfe6-6158-43f2-961d-f50d398f79d6 on hv-cinder-85931 Sep 26 17:58:20.903691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-4b6d15be-fd6a-441a-8246-657d694023ef req-a81ea1d9-c6e6-421d-b71e-29da13205b26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038571 Sep 26 17:58:20.904385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 83/183] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:21.219585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:21.220167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:21.227019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.227498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.227960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.228643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.229176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.229653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.358095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:21.366353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6a1880b5-c715-4d88-9d91-02576e5f647e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.150758 Sep 26 17:58:21.367013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 101/184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:21 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:21.404455 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:21.405420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:21.412418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.412898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.413356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.414057 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.414503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.414920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.544499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:21.552095 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-21d6cfa4-10b6-4a14-a4ab-e996d1c9a0aa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.151951 Sep 26 17:58:21.552647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 84/185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:21 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:21.729950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:21.730553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:21.736602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.738603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.738603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.738603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.738603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.739166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.876475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:21.883095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5464933c-b8cc-4b8d-86da-f8e5f22cbfe4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.157004 Sep 26 17:58:21.883641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 102/186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:21 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:21.918922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:21.919612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:21.926458 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.926954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.927379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.928052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:21.928510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:21.928931 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:21.950718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:22.067317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:22.075264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:22.076717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:22.077919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3311b980-cd54-4bee-90ac-87e3888a6881 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.163072 Sep 26 17:58:22.078497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 85/187] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:21 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:22.388985 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:22.389632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:22.395731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.403307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.403307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:22.403307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.403307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.403640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:22.565881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:22.574325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9125f56d-4606-4d54-ba89-aa9fb6a5c80f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.189097 Sep 26 17:58:22.574820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 103/188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:22 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:22.576176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:22.576785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:22.582732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.583304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.583818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:22.584519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.584974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.585437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:22.730723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:22.740460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f7816302-ef16-4639-a58c-11697fdb648a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.169394 Sep 26 17:58:22.741541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 86/189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:22 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:22.907371 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:22.908661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:22.921490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.922118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.922654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:22.923547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:22.925640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:22.926178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.077612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.086626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a5b61573-289e-432d-b56b-f6afb547e6b8 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.183455 Sep 26 17:58:23.087274 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 104/190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:22 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:23.106959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:23.107610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:23.115822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.115822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.115822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.116265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.116674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.117092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.248642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.257047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.258506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.259595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-67c2eea1-9623-4d48-819c-e56852cf0503 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.156690 Sep 26 17:58:23.260141 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 87/191] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:23 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:58:23.597723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:23.598336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:23.604168 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.604648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.605105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.605839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.606290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.606709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.741134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.749053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fb4077d0-4752-4446-95b8-f3ab93c32d9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.155281 Sep 26 17:58:23.749642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 105/192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:23 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:23.763047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:23.763664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:23.770464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.770945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.771380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.772366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:23.772821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:23.773276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:23.908462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:23.916101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f14f5ff1-20aa-45d9-af7b-966730d52bc5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.157325 Sep 26 17:58:23.916667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 88/193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:23 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:24.110112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:24.110707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:24.117083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.117592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.118016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.118758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.119207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.119624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.276194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:24.285615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aee8e7a6-f71a-4c9a-8f94-28b51f00b8f4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.179257 Sep 26 17:58:24.285897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:24.286621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:24.286808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 106/194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:24 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:24.293543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.294025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.294457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.295152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.295650 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.296074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.424645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:24.432569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:24.434020 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:24.435102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-72a64860-2c21-4f7d-84c2-730ddf63de65 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1407 microversion: 2.20 time: 0.153674 Sep 26 17:58:24.435644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 89/195] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:24 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:58:24.772794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:24.773585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:24.781678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.782231 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.782748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.783818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.784346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.784836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.865249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158e230e-aa1a-4311-81fc-5815c8cf0f64", "name": "network-vif-plugged", "status": "completed", "tag": "dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:24.876237 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.876792 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.877247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.888770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] Creating event network-vif-plugged:dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a for instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 on hv-cinder-85931 Sep 26 17:58:24.893778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-a0a4f3bf-31aa-474b-ab8b-f2c9b6101e72 req-ba156d77-a666-491d-946a-b9c87f44bc83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Sep 26 17:58:24.895011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 90/196] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:24.928625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:24.936545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-934c0db8-14c7-43a1-a4eb-ce2bdc048f9f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.168479 Sep 26 17:58:24.937110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 107/197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:24 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:24.940705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:24.941985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:24.948214 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.948693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.949126 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:24.951100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:24.951100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:24.957418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.124270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:25.132174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c52415e9-2e11-46a2-80cd-3af741efe59a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.196069 Sep 26 17:58:25.132754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 91/198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:24 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:25.310151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:25.310765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:25.322832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.322832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.322832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.322832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.323170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.323170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.447275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:25.455591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dae9de3d-ade3-4555-9c83-ef75e7a4d976 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.148946 Sep 26 17:58:25.456162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 108/199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:25 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:25.461410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:25.462017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:25.468677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.469151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.469619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.470329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.470781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.471228 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.609816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:25.620234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:25.622104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:25.623542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3fc8f73d-e2a3-448f-aa41-6b3d9ddcec1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1598 microversion: 2.20 time: 0.166748 Sep 26 17:58:25.624130 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 92/200] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:58:25 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:58:25.656145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:25.656730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:25.664434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.664924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.674363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.675103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.676174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.676608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.762985 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a9ab7b6b-889c-4002-9761-482b37e255cd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111422 Sep 26 17:58:25.764015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 109/201] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 17:58:25 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:58:25.962846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:25.963516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:25.969474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.970053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.970488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:25.971183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:25.971633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:25.972051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:26.155869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:26.156481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:26.163858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:26.164522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:26.165106 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:26.165975 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:26.166757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:26.167365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:26.454065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:26.462504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b1d28479-8caf-43ba-9628-3a9dc4cf81d0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1361 microversion: 2.1 time: 0.504356 Sep 26 17:58:26.463170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 93/202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:25 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:26.479383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:26.480139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:26.486554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:26.487040 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:26.487479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:26.488241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:26.488696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:26.489122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:26.573433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:26.585602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-56b9636e-0eda-4bf2-80be-c81ae1c91cde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.433537 Sep 26 17:58:26.586930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 110/203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:26 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:27.110251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:27.118949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2d201177-758c-47f3-b293-717f12ac9b2e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.643452 Sep 26 17:58:27.119883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 94/204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:26 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:27.485134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:27.492490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:27.492773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.493140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.493619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.494308 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.494759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.495180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.636283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:27.636283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:27.636283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.636283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.636550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.636550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.636550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.636550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.735130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:27.744422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a6db32cb-6e60-402f-b9d0-9d00c0208a82 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1546 microversion: 2.1 time: 0.262831 Sep 26 17:58:27.745178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 111/205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:27 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:27.768551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:27.769621 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:27.785859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.785859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.785859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.785859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.786170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.786170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.900839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:27.910236 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2f260e8c-c93c-4a7b-b7e0-b3b46f4ce88e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145691 Sep 26 17:58:27.910914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 112/206] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 17:58:27 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:58:27.923965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:27.937565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6192cd76-9b2b-4d61-861b-4e8b36b351dc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.330200 Sep 26 17:58:27.938659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 95/207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:27 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:27.953269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:27.953953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:27.954461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:27.967655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] Creating event network-changed:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 17:58:27.974294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-d6f32436-62f2-4d13-ab9c-ab6b1128ef2a req-a0f64b78-fc1b-49e6-a4ec-48931f4b3226 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053746 Sep 26 17:58:27.975012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 113/208] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:28.141957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:28.143178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:28.149992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:28.150859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:28.151449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:28.152356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:28.153049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:28.153655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:28.388921 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:28.403385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9957d88d-9bc4-45ac-a836-099bae0c3df9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.265382 Sep 26 17:58:28.419046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 96/209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:28 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:28.963096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:28.963913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:28.970648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:28.971244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:28.971741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:28.973252 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:28.973784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:28.974277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:29.307223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:29.310774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:29.315286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1cfddaf7-b89f-4c30-b74f-d29d363815bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.356643 Sep 26 17:58:29.316188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 114/210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:28 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:29.428023 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:29.428759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:29.436266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:29.436748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:29.437380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:29.438074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:29.438525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:29.438949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:29.573051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:29.580963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ea5c59e9-7412-4e07-b2d6-d10281ef1cbe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.157537 Sep 26 17:58:29.582420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 97/211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:29 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:29.992788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b533dfe6-6158-43f2-961d-f50d398f79d6", "tag": "35e30149-7490-417a-a493-6bef261bb382"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:30.003697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:30.004144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:30.004577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:30.015851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] Creating event network-changed:35e30149-7490-417a-a493-6bef261bb382 for instance b533dfe6-6158-43f2-961d-f50d398f79d6 on hv-cinder-85931 Sep 26 17:58:30.020884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-8afec5ee-fa57-4df2-94ec-18ca67d19b24 req-0804dca4-6924-4437-8f26-f26b543c9046 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033599 Sep 26 17:58:30.021543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 115/212] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:30.338382 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:30.339134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:30.345347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:30.345916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:30.346419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:30.347705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:30.348224 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:30.348716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:30.484170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:30.491866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-df23ebaf-c97a-47a8-8f9c-0b8e870180ae tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.157512 Sep 26 17:58:30.492931 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 98/213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:30 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:30.612704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:30.613696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:30.619833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:30.620310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:30.620740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:30.621471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:30.621921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:30.622367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:30.762660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:30.771100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-46ab23cc-5010-43de-a1c6-a715819bdacc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.162877 Sep 26 17:58:30.777528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 116/214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:30 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:31.514781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:31.521874 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:31.521983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:31.522431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:31.522863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:31.523546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:31.523996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:31.524418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:31.650239 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:31.658301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c0c1a18d-703c-47f0-9e82-c4be527713db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.147385 Sep 26 17:58:31.658863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 99/215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:31 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:31.794925 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:31.795534 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:31.801712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:31.802190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:31.803262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:31.803949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:31.804404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:31.804830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:31.933835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:31.941811 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-78b43afd-2edc-41de-a6c8-417d78c59ee7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.150798 Sep 26 17:58:31.945806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 117/216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:31 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:32.682308 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:32.692166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:32.692166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:32.692166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:32.692166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:32.692526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:32.692526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:32.692526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:32.821056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:32.828871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fd507f29-b549-44e9-97a2-27e633b7c3e2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.151088 Sep 26 17:58:32.829625 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 100/217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:32 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:32.966637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:32.967248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:32.973153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:32.973660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:32.974095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:32.974804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:32.975249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:32.975669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:33.103516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:33.111169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ccf284e1-edbf-4a7d-b9f5-47903c6ef771 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.148338 Sep 26 17:58:33.111818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 118/218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:32 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:33.852419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:33.853049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:33.859386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:33.859858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:33.860281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:33.860953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:33.861431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:33.861849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:34.008110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:34.016176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bfa0b24f-927c-4825-988f-753e39ae0a87 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.168004 Sep 26 17:58:34.016971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 101/219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:33 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:34.133953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:34.134564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:34.140523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:34.141001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:34.141478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:34.142161 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:34.142608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:34.143031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:34.269814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:34.278256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-25fbb01f-a939-49b9-a5b9-b27fc469b0b2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.148147 Sep 26 17:58:34.278808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 119/220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:34 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:35.041155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:35.041804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:35.048438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:35.048923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:35.049404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:35.050099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:35.050547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:35.050970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:35.182987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:35.186595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:35.191053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e6433f16-d043-471f-ba40-6a703f222daf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.153817 Sep 26 17:58:35.191618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 102/221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:35 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:35.301988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:35.303181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:35.309124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:35.309642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:35.310078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:35.310796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:35.311251 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:35.311675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:35.440875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:35.448544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2ad91d8b-8c10-4651-9043-5c5dfd40f85a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.150377 Sep 26 17:58:35.449104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 120/222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:35 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:36.214270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:36.214814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:36.221366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:36.221844 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:36.222284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:36.222974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:36.223457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:36.223878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:36.354955 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:36.362787 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-48061a88-2680-43ad-b63a-24a64edad2cb tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.152666 Sep 26 17:58:36.363353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 103/223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:36 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:36.471538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:36.472148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:36.478921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:36.479413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:36.479843 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:36.480537 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:36.481039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:36.481493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:36.674870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:36.682618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b3b7cb7a-73ee-4a81-8ad6-43ed56569d21 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.214899 Sep 26 17:58:36.683179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 121/224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:36 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:37.386813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:37.387413 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:37.393940 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.394414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.394843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.395522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.395970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.396381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.453535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:37.459099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:37.460363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.460841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.461295 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.461988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.462437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.462906 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.488385 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 17:58:37.526505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:37.534292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-66263a19-0cb7-462f-9a7f-1297675681e8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.151296 Sep 26 17:58:37.534850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 104/225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:37 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:37.706812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:37.707424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:37.714058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.714543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.714979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.715668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.716122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.716555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.820484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b82d76b7-eea5-4034-a58b-5d7c7108ac88 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 204 len: 0 microversion: 2.1 time: 0.370676 Sep 26 17:58:37.821073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 122/226] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 17:58:37 2022] DELETE /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 17:58:37.829274 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:37.833399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:37.836679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.837253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.837758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.838690 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:37.839670 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:37.840155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:37.849538 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:37.859492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-254bd80f-3e26-44de-bcaf-2a40697301cd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.156538 Sep 26 17:58:37.860250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 105/227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:37 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:37.970603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:37.978728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ff4a07bb-198a-478b-a105-9e1261dea456 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.153409 Sep 26 17:58:37.979291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 123/228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:37 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:38.556489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:38.557108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:38.563522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:38.564005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:38.564441 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:38.565131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:38.565613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:38.566085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:38.696356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:38.704049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3e4c4302-ba8a-4eec-ae4d-58e6b83b72a2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.151903 Sep 26 17:58:38.704655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 106/229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:38 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:38.884913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:38.885470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:38.891631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:38.892123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:38.892562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:38.893284 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:38.893749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:38.894172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:39.001839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:39.002621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:39.008574 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:39.009134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:39.009671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:39.010428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:39.010889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:39.011313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:39.021787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:39.031135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-edb40232-83ee-4518-bf0f-731261b763e6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.150695 Sep 26 17:58:39.031877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 124/230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:38 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:39.138561 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:39.146979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3df2367b-e80e-4867-adae-794b0e640d08 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.149029 Sep 26 17:58:39.147535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 107/231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:38 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:39.726702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:39.727311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:39.733188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:39.733700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:39.734139 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:39.734839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:39.735295 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:39.735722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:39.865448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:39.873091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-46a5a657-cf9b-4ae4-b341-94f1335aa716 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.150273 Sep 26 17:58:39.873679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 125/232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:39 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:40.056485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:40.057147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:40.064307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.064850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.065421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:40.066172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.066631 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.067061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:40.169439 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:40.170062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:40.176233 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.176719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.177185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:40.177900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.178364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.179314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:40.196164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:40.203784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5fd6cbfd-81fa-4eee-9812-2a2ba1a4cfd7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.151753 Sep 26 17:58:40.204360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 108/233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:40 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:40.306932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:40.315130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d56e5435-2237-46f7-8891-3543da413fd4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.149636 Sep 26 17:58:40.315724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 126/234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:40 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:40.896327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:40.896938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:40.903300 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.903783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.904489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:40.905171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:40.905646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:40.906070 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:41.037506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:41.050258 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b79391fa-368f-445b-9f80-7e17680b2cd6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.157768 Sep 26 17:58:41.051311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 109/235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:40 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:41.226294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:41.226832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:41.232635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:41.233154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:41.233623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:41.234315 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:41.234758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:41.235181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:41.338461 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:41.339165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:41.346110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:41.346600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:41.347036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:41.347730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:41.348181 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:41.348608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:41.363966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:41.372353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-48c624f5-d4e2-422b-a2ed-850111ccc0c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.149915 Sep 26 17:58:41.372955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 127/236] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:41 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:41.478978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:41.487173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-07190ac6-ee1b-4ec5-aab4-5e95951094c4 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.153106 Sep 26 17:58:41.487772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 110/237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:41 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:42.076408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:42.077046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:42.083082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.083582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.083998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.084686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.085167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.085623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.227663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:42.235447 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-719d360b-6d85-4776-8f68-6a87b2b77289 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.163267 Sep 26 17:58:42.236195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 128/238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:42 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:42.395493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:42.396109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:42.402800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.405146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.405146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.405146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.405146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.405561 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.525072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:42.525072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:42.525072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.525072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.525437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.525437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:42.525437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:42.525437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:42.541087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:42.549080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1d484c48-1c19-48e9-ba1e-d9bba82be3d3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.157421 Sep 26 17:58:42.549684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 111/239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:42 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:42.657069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:42.670227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-73d2c35f-0324-4855-8c90-52d8a22a7476 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.163587 Sep 26 17:58:42.670504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 129/240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:42 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:43.260070 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:43.260620 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:43.266934 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.267421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.267851 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.268789 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.269260 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.269725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.407303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:43.416525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3a249f0b-7b12-4312-9d21-166b3cb81ee9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1367 microversion: 2.1 time: 0.161015 Sep 26 17:58:43.417145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 112/241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:43 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:43.572561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:43.573181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:43.579785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.581402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.581402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.581639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.582168 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.582666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.601940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:43.692320 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:43.693417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:43.699099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.699589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.700085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.700841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:43.701319 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:43.701752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:43.711760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:43.719542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d36386ec-b070-4d64-8513-ddfc1f0dd589 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.151248 Sep 26 17:58:43.720101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 130/242] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:43 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:43.829858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:43.838967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bccee8ab-3294-4db5-8052-7dc4a261be90 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.150487 Sep 26 17:58:43.844420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 113/243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:43 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:44.442293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:44.442909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:44.450174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.450660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.451178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.451915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.452426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.452853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.617699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:44.625610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-542d2aa1-9656-407f-ba5d-30c8e86438d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1556 microversion: 2.1 time: 0.187424 Sep 26 17:58:44.626133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 131/244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:44 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:44.649684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:44.650230 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:44.657138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.657762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.658298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.659059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.659585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.660077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.741343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-00a2c1ef-9207-411e-9084-1257eb52b368 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095803 Sep 26 17:58:44.742494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 114/245] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 17:58:44 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:44.744885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:44.745566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:44.751608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.752095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.752530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.753240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.753701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.754131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.874636 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:44.875260 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:44.881557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.882575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.883027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:44.883780 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:44.884243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:44.884673 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:45.167738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:45.175529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0a749e20-631f-4602-9ff4-1beb4f7dad34 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.435223 Sep 26 17:58:45.195552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 132/246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:44 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:45.276818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:45.285518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c8a3f8df-827e-4275-b132-d1045fe1c931 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.416567 Sep 26 17:58:45.286174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 115/247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:44 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:46.218591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:46.219436 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:46.221403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:46.227536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.228161 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.228881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.230538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.231256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.231798 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.310666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:46.311277 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:46.313626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=91 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:46.321716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.324732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.326184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.332686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.333173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.333701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.439590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:46.455773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-01ad0ea8-c7ca-43bb-94a4-e063ef33ad48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.240549 Sep 26 17:58:46.461722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 133/248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:46 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:46.475538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158e230e-aa1a-4311-81fc-5815c8cf0f64", "tag": "dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:46.490637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.491440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.491902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.507123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] Creating event network-changed:dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a for instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 on hv-cinder-85931 Sep 26 17:58:46.515660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-e62c1533-6424-4429-a305-dcc47c50b461 req-4fc3d756-afcc-4ea7-874a-dae1fdf23577 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051360 Sep 26 17:58:46.517331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 134/249] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:46.553246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:46.563944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-846bc603-b87b-47f5-bcd2-bea03184c46c tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1553 microversion: 2.1 time: 0.258051 Sep 26 17:58:46.565665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 116/250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:46 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:46.954389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad9fb3e-9580-4855-bd01-23c73ebc5697", "name": "network-vif-deleted", "tag": "df1af5ff-3f2c-4a25-b273-3c032923423a"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:58:46.969867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:46.970338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:46.970761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:46.992325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] Creating event network-vif-deleted:df1af5ff-3f2c-4a25-b273-3c032923423a for instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 on hv-cinder-85931 Sep 26 17:58:46.999880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-7b1fe0d5-cc0a-47cd-958e-85034847f3c6 req-a21df9db-4e8e-4722-964d-bc7903dab402 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054883 Sep 26 17:58:47.001980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 135/251] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:58:47.485057 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:47.485841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:47.493811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:47.494873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:47.495586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:47.496512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:47.497679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:47.498583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:47.589592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:47.590489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:47.598810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:47.599681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:47.600596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:47.601499 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:47.601959 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:47.602575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:47.750638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:47.759897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bb7e2f61-1b02-4e6f-bee7-b4f7e57bdc06 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1346 microversion: 2.1 time: 0.175416 Sep 26 17:58:47.768148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 136/252] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:47 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:58:47.779733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:47.790914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ba835038-47f5-4826-99ec-85c0aa5c4d69 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.310311 Sep 26 17:58:47.792315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 117/253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:47 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:48.796151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:48.797388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:48.803262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:48.803755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:48.805002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:48.805738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:48.806198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:48.806660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:48.815821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:48.816425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:48.825668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:48.833159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:48.835409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:48.835409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:48.836037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:48.836037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:49.009555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:49.010602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:49.011198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:49.011823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lazy-loading 'fault' on Instance uuid 4ad9fb3e-9580-4855-bd01-23c73ebc5697 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:58:49.013601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:49.023014 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d43fe5b0-0c65-458a-8d61-77b33680533f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.211384 Sep 26 17:58:49.024361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 118/254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:48 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:49.071503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cc3751553491ba18b9a6f2e2f5e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd1fad813d94b6cba21a788b11d2cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:49.080768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e9cae1a2-cacd-4889-b083-b106ab40d9e3 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 200 len: 1351 microversion: 2.1 time: 0.289647 Sep 26 17:58:49.081801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 137/255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:48 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 1351 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:50.047636 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:50.049684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:50.058487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.059252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.059779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.060484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.060942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.061399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.104163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:50.104792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:50.112780 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.113505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.113942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.114810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.115259 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.115859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.132010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] HTTP exception thrown: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Request method failure captured: Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 HTTP/1.1 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKk7k-SQFv-Up800ppUL8iP0GKpnNl-1gYdJY4o-RAfXrgIUNgmSR88jcM3on6Voe2V5pb60flEXEWSN4eiyVoPjSUFgMFZjkkb4man594U-1X1HxpaUd5hXFn7OmAtxoG_HZtoPc-4rUWNALK1h0IbqPsrntdOUgsXT9Ohz6xD6I Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:58:50.138099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd1fad813d94b6cba21a788b11d2cd8"}]}] Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 3b0cc3751553491ba18b9a6f2e2f5e14 Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.139654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '4ad9fb3e-9580-4855-bd01-23c73ebc5697'} Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:58:50.140303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.141608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.145112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Returning 404 to user: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:58:50.146182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5213629f-27d9-47ea-8f9e-33c773cd1342 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 404 len: 111 microversion: 2.1 time: 0.046382 Sep 26 17:58:50.146744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 138/256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:50 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 17:58:50.229675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:50.233042 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:50.237599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d6ee9970-bf72-4e0e-a547-6d1554b50110 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.193928 Sep 26 17:58:50.238158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 119/257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:50 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:50.654636 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:50.656773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:50.662842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.667661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.667661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.667661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:50.667661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:50.668062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:50.680155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] HTTP exception thrown: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Request method failure captured: Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697/os-volume_attachments HTTP/1.1 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKk7k-SQFv-Up800ppUL8iP0GKpnNl-1gYdJY4o-RAfXrgIUNgmSR88jcM3on6Voe2V5pb60flEXEWSN4eiyVoPjSUFgMFZjkkb4man594U-1X1HxpaUd5hXFn7OmAtxoG_HZtoPc-4rUWNALK1h0IbqPsrntdOUgsXT9Ohz6xD6I Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:58:50.681768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd1fad813d94b6cba21a788b11d2cd8"}]}] Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 3b0cc3751553491ba18b9a6f2e2f5e14 Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.682915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'server_id': '4ad9fb3e-9580-4855-bd01-23c73ebc5697'} Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:58:50.683575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:50.684716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:50.685940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Returning 404 to user: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:58:50.685940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d6e6afad-4ed2-4145-a994-a277a89cc4a5 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032755 Sep 26 17:58:50.685940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 139/258] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 17:58:50 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:58:51.259915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:51.260649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:51.267762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:51.268243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:51.268679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:51.269401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:51.269852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:51.270271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:51.404274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:51.412179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d1bc08be-847b-49fc-bd1f-69c1f5a6cef1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.156208 Sep 26 17:58:51.412749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 120/259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:51 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:52.196241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:52.196828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:52.203053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.207068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.207068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.207068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.207068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.207378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.218966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] HTTP exception thrown: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Request method failure captured: Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 HTTP/1.1 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKk7k-SQFv-Up800ppUL8iP0GKpnNl-1gYdJY4o-RAfXrgIUNgmSR88jcM3on6Voe2V5pb60flEXEWSN4eiyVoPjSUFgMFZjkkb4man594U-1X1HxpaUd5hXFn7OmAtxoG_HZtoPc-4rUWNALK1h0IbqPsrntdOUgsXT9Ohz6xD6I Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:58:52.220561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd1fad813d94b6cba21a788b11d2cd8"}]}] Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 3b0cc3751553491ba18b9a6f2e2f5e14 Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.222146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '4ad9fb3e-9580-4855-bd01-23c73ebc5697'} Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:58:52.222938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.224159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.225900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Returning 404 to user: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:58:52.225900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f046bcf6-632b-4ea4-90ad-aeea3f177235 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 404 len: 111 microversion: 2.1 time: 0.030285 Sep 26 17:58:52.225900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 140/260] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 17:58:52 2022] DELETE /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:58:52.241165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:52.241165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] [instance: 4ad9fb3e-9580-4855-bd01-23c73ebc5697] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:52.241165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.241165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.242572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.242572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.242572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.242572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.256108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] HTTP exception thrown: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Request method failure captured: Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 HTTP/1.1 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegKk7k-SQFv-Up800ppUL8iP0GKpnNl-1gYdJY4o-RAfXrgIUNgmSR88jcM3on6Voe2V5pb60flEXEWSN4eiyVoPjSUFgMFZjkkb4man594U-1X1HxpaUd5hXFn7OmAtxoG_HZtoPc-4rUWNALK1h0IbqPsrntdOUgsXT9Ohz6xD6I Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 17:58:52.261665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd1fad813d94b6cba21a788b11d2cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd1fad813d94b6cba21a788b11d2cd8"}]}] Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 6cd1fad813d94b6cba21a788b11d2cd8 Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-DeleteServersTestJSON-161468181 Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 3b0cc3751553491ba18b9a6f2e2f5e14 Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-DeleteServersTestJSON-161468181-project Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.263582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '4ad9fb3e-9580-4855-bd01-23c73ebc5697'} Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:58:52.264389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. Sep 26 17:58:52.265805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 17:58:52.266960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] Returning 404 to user: Instance 4ad9fb3e-9580-4855-bd01-23c73ebc5697 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:58:52.266960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1fb05dda-9100-4f6e-9afd-3fa563db2442 tempest-DeleteServersTestJSON-161468181 tempest-DeleteServersTestJSON-161468181-project] 10.222.0.49 "GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697" status: 404 len: 111 microversion: 2.1 time: 0.038483 Sep 26 17:58:52.271068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 121/261] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:52 2022] GET /compute/v2.1/servers/4ad9fb3e-9580-4855-bd01-23c73ebc5697 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 17:58:52.438253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:52.439038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:52.445281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.445856 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.446413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.447109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:52.447562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:52.448036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:52.590756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:52.600277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cd0c76e7-011c-4a54-b282-1b8cd577a414 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.167738 Sep 26 17:58:52.601384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 141/262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:52 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:53.628061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:53.629477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:53.636052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:53.636544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:53.637169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:53.638055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:53.638510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:53.638988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:53.792028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:53.799742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-98605cef-d210-431b-b0f9-cdecae0e5706 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.179595 Sep 26 17:58:53.800310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 122/263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:53 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:54.825945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:54.827404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:54.835230 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:54.835936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:54.836578 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:54.837522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:54.837989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:54.838419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:54.976838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:54.984772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-da25d403-7939-4736-876e-5ebdccb83739 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.163311 Sep 26 17:58:54.985568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 142/264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:54 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:56.008523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:56.009126 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:56.015630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:56.016116 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:56.017183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:56.017919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:56.018369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:56.018866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:56.178681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:56.189325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-00ab8597-8a7c-42df-8869-d4d8dd7d54db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.185121 Sep 26 17:58:56.189823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 123/265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:56 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:57.223032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:57.223627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:57.233256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:57.233256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:57.233256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:57.234425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:57.234963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:57.235461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:57.366670 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:57.374365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dc9f15c1-714e-43e1-8af2-11e6c2b08caa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.155818 Sep 26 17:58:57.374931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 143/266] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:57 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:58.398640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:58.399400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:58.405803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:58.406286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:58.406717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:58.407407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:58.407858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:58.408279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:58.549492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:58.557510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6ee07028-b705-407d-9ec7-ece3a59914fc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.163476 Sep 26 17:58:58.558075 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 124/267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:58 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:58:59.581074 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:58:59.581626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:58:59.587571 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:59.588093 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:59.588524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:59.589207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:58:59.589684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:58:59.590110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:58:59.719512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:58:59.727964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5386a23e-f8a0-44e7-a23c-a06967f0e93a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.150986 Sep 26 17:58:59.728525 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 144/268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:58:59 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:00.751849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:00.752568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:00.760773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:00.761724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:00.762254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:00.763507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:00.763916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:00.774592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:00.912749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:00.921562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cc02682e-e41c-4f3e-b97b-ecf6d39d0a92 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.174337 Sep 26 17:59:00.922125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 125/269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:00 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:01.945152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:01.945838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:01.951845 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:01.952396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:01.952835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:01.953676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:01.954136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:01.954566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:02.086413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:02.094205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7b3899c5-a483-4dcf-b799-a6cac7db6636 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.153727 Sep 26 17:59:02.094756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 145/270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:01 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:03.119052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:03.120408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:03.126977 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:03.127459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:03.127887 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:03.128580 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:03.129033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:03.129484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:03.407591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:03.415817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9ba67c5c-27ad-4a8c-a557-7108080f8481 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.301466 Sep 26 17:59:03.416385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 126/271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:03 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:04.437950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:04.438570 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:04.445160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:04.445709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:04.451930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:04.451930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:04.451930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:04.451930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:04.589398 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:04.600801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2709ed6b-db21-4cae-8554-a0692f41aac2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.165860 Sep 26 17:59:04.603399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 146/272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:04 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:05.628186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:05.628970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:05.636982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:05.637557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:05.638194 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:05.639077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:05.639497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:05.639986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:05.789509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:05.797508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7903b077-093b-4b74-bb41-0b11b3525871 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.173313 Sep 26 17:59:05.798094 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 127/273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:05 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:06.823807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:06.825016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:06.833284 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:06.834791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:06.835311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:06.836132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:06.837539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:06.838173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:06.998091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:07.006772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-92fbcde4-89e2-44d0-b1de-9f3c338a72a7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.187350 Sep 26 17:59:07.007331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 147/274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:06 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:08.031056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:08.031668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:08.038177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:08.038665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:08.039354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:08.040059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:08.040506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:08.040933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:08.216054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:08.231203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c7cad2cf-1b32-45f5-94a1-687a796666e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.204278 Sep 26 17:59:08.233936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 128/275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:08 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:09.259992 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:09.260604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:09.267169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:09.267643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:09.268081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:09.268765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:09.269247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:09.269677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:09.417890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:09.426170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-146b8a4b-0382-4beb-adb5-76acd742c0db tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.170130 Sep 26 17:59:09.426692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 148/276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:09 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:10.450084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:10.450686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:10.457060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:10.457575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:10.458005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:10.458687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:10.459134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:10.460240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:10.616499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:10.624889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-65695a49-8d18-4c3b-ae4e-d51fe3ee68fa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.178571 Sep 26 17:59:10.625599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 129/277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:10 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:11.656853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:11.657607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:11.664528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:11.665333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:11.666089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:11.666894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:11.667567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:11.668204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:11.811309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:11.814083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b3ed0744-cb69-4e46-a512-202fc54ab422 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.167652 Sep 26 17:59:11.814814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 149/278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:11 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:12.840739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:12.841485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:12.848596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:12.849088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:12.849560 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:12.850800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:12.851474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:12.851948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:13.038367 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:13.046165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dcab4d54-dd04-4219-b19c-2f596fe108fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.209720 Sep 26 17:59:13.046821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 130/279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:12 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:14.072223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:14.073822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:14.084104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:14.084827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:14.085291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:14.097995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:14.097995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:14.097995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:14.097995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:14.232136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:14.240475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-916177d8-d761-4cca-9f77-c203b2afed48 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.175492 Sep 26 17:59:14.241639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 150/280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:14 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:15.279717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:15.281116 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:15.289738 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:15.290241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:15.290815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:15.291678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:15.292137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:15.292577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:15.464911 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:15.472960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-400b964e-7df6-4ebf-9044-0592414d6c30 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.198729 Sep 26 17:59:15.473966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 131/281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:15 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:16.497001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:16.497644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:16.504418 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:16.504900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:16.505362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:16.506747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:16.507402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:16.508028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:16.648721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:16.657242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6bec0116-0a32-4c42-8a65-19122ee4449e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.164132 Sep 26 17:59:16.664762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 151/282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:16 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:17.479182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1023474707", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:17.535331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] validate_networks() for None {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:59:17.681410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:17.682055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:17.684000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=40 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:17.688656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:17.689146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:17.689618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:17.690464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:17.691089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:17.691524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:17.852237 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:59:17.852728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:59:17.853296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:59:17.853766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:59:17.854273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:59:17.856296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=34 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:17.863679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:17.864268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:17.864712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:17.865596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:17.866151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:17.866640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:17.880265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:17.884088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Getting quotas for project b926bedb2ce44850b9a7ce09dc2f73ff. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:59:17.888315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Getting quotas for user c024ff310ff7443c90046e999a2dcaf7 and project b926bedb2ce44850b9a7ce09dc2f73ff. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:59:17.889855 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b5f06985-ce21-4fbb-b33c-b0a67f79d573 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1522 microversion: 2.1 time: 0.212396 Sep 26 17:59:17.890807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 152/283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:17 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:17.904804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:59:17.907386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:59:18.065480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9d0372e6-f75a-4543-9d1f-43e52a38a78e tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590923 Sep 26 17:59:18.075399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 132/284] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 17:59:18.078359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cad4d59e-4ba9-414e-8eea-a3e7569016e8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:18.079103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cad4d59e-4ba9-414e-8eea-a3e7569016e8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:18.150865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cad4d59e-4ba9-414e-8eea-a3e7569016e8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:18.158411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cad4d59e-4ba9-414e-8eea-a3e7569016e8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1215 microversion: 2.1 time: 0.084361 Sep 26 17:59:18.159008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 153/285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:18 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:18.914763 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:18.915379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:18.922343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:18.923014 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:18.923454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:18.924149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:18.924918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:18.925387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:19.053998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:19.061583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d347aad1-ef2c-4490-8651-e6626cc730a1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1502 microversion: 2.1 time: 0.151494 Sep 26 17:59:19.074140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 133/286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:18 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:19.084541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:19.085209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:19.091264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:19.091753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:19.092195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:19.092921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:19.093410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:19.093842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:19.185313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b2251a6e-42da-4fea-ab1a-6699c3ccd384 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:19.185959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b2251a6e-42da-4fea-ab1a-6699c3ccd384 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:19.244609 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b2251a6e-42da-4fea-ab1a-6699c3ccd384 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:19.247797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:19.251588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b2251a6e-42da-4fea-ab1a-6699c3ccd384 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1215 microversion: 2.1 time: 0.070226 Sep 26 17:59:19.252156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 134/287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:19 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:19.257967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-56e1b86a-f243-45ca-a59d-862e0276649d tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1516 microversion: 2.1 time: 0.177786 Sep 26 17:59:19.258633 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 154/288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:19 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:20.275043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:20.275659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:20.283156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:20.283680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:20.284119 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:20.284814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:20.285296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:20.285721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:20.348129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:20.356413 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6a0a0174-a645-46ad-8460-ffa71e6e1ff0 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1211 microversion: 2.1 time: 0.085574 Sep 26 17:59:20.356986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 135/289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:20 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:21.240204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:21.243007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:21.249004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.249509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.249938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.250627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.251073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.251493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.275045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'flavor' on Instance uuid de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:59:21.380328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:21.381010 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:21.394067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.394067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.394067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.394067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.394501 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.394501 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.394501 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=83 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:21.465384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:21.473330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1e7fb813-e22d-4982-8852-22b290eb4383 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1275 microversion: 2.1 time: 0.096838 Sep 26 17:59:21.473906 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 136/290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:21 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:21.671102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-61f09c5b-562c-44fc-906d-8ae4570008f7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/action" status: 200 len: 32 microversion: 2.1 time: 0.435762 Sep 26 17:59:21.671741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 155/291] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 17:59:21 2022] POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 17:59:21.683443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:21.685565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:21.694727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.695456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.696112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.696828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:21.697531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:21.697998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:21.827494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:21.836195 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-faddde15-9d2b-462f-8bd7-9d3d748cff87 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.158329 Sep 26 17:59:21.836769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 137/292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:21 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:22.500386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:22.501852 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:22.509412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:22.509972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:22.510394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:22.511450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:22.511916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:22.512230 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:22.589390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:22.597712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7c323353-8145-4056-9479-7a7c49bbe397 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1273 microversion: 2.1 time: 0.103339 Sep 26 17:59:22.599143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 156/293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:22 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:22.859141 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:22.859757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:22.867170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:22.867659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:22.868099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:22.868792 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:22.869276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:22.869711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:23.041649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:23.049873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4ada4e2f-1368-4bce-8873-468081ae7b90 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.194836 Sep 26 17:59:23.050921 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 138/294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:22 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:23.623719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:23.629983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:23.640398 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:23.641931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:23.642360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:23.643644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:23.644810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:23.645584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:23.906292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:23.906292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-35e0bdb9-4b7d-4bdc-b36e-335e41ea58ac tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.202523 Sep 26 17:59:23.906292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 157/295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:23 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:24.075397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:24.076013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:24.083815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:24.084927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:24.085389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:24.086087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:24.086596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:24.087026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:24.276799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:24.285425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-af0abda7-6f40-43e5-b48c-1d9f374dfc85 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.213676 Sep 26 17:59:24.286016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 139/296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:24 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:24.545759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c056eb-7a7d-425c-bca7-166be4ed38f0", "tag": "a57efb69-8445-44ce-a652-97961a863de6"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:24.555415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:24.555894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:24.558399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:24.567503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] Creating event network-changed:a57efb69-8445-44ce-a652-97961a863de6 for instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 on hv-cinder-85931 Sep 26 17:59:24.572264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-3bdc4b31-5dc5-4cf2-8ba4-1eb33a67feb8 req-cbfe12a5-ae10-41c2-8114-1a832a07433e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030449 Sep 26 17:59:24.572851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 158/297] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:24.918781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:24.919543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:24.925960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:24.926380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:24.926851 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:24.927733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:24.928960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:24.929417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:25.095321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:25.105183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-db85b86d-966a-4e1a-8a6a-4664b9910603 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.190640 Sep 26 17:59:25.105816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 140/298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:24 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:25.310436 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:25.311903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:25.318916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:25.319707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:25.320318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:25.321255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:25.322006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:25.322620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:25.501937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:25.511159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-556ba712-57a3-4a7c-8ddf-5d576763f042 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.204824 Sep 26 17:59:25.512582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 159/299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:25 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:26.128152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:26.133924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:26.136837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:26.137348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:26.137959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:26.138827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:26.139436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:26.139865 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:26.282685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:26.291191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7b746f06-3409-42b1-9b7d-bc3ef38485a8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.166855 Sep 26 17:59:26.306750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 141/300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:26 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:26.534767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:26.536118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:26.542774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:26.543294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:26.544463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:26.545855 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:26.546459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:26.547155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:26.950181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:26.961666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f1ae87a7-b790-4961-a8f4-bf860206c7fd tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.430617 Sep 26 17:59:26.978510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 160/301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:26 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:27.317061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:27.317721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:27.324960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:27.325505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:27.325927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:27.326629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:27.327308 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:27.327733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:27.485614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:27.494747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-62b55bd5-8058-4427-bbaa-aecd1e3a8742 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.184011 Sep 26 17:59:27.495866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 142/302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:27 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:27.987863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:27.988484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:27.994455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:27.994936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:27.995371 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:27.996061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:27.996515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:27.996939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:28.157115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:28.183841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:28.191810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8bba9c06-5db0-4587-b20f-0070ce45e0c3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.207950 Sep 26 17:59:28.192374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 161/303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:27 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:28.518182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:28.518960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:28.520826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:28.526548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:28.527025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:28.527707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:28.528395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:28.528840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:28.529281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:28.683278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:28.690854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7e677805-126b-4a1a-8a79-174cc64440da tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.176480 Sep 26 17:59:28.691596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 143/304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:28 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:29.215346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:29.218888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:29.222516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:29.222997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:29.223433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:29.224135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:29.225103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:29.225558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:29.373598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:29.381977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5a7303db-8836-44c3-9658-72d0aa197d98 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.170481 Sep 26 17:59:29.383603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 162/305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:29 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:29.716890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:29.721307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:29.722400 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=8 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:29.727060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:29.727541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:29.727973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:29.728668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:29.729123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:29.729596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:29.874558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:29.886237 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e0b0b58a-972d-429f-b55f-f975381b2df7 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.174754 Sep 26 17:59:29.887135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 144/306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:29 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:30.406186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:30.406832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:30.414937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:30.414937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:30.414937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:30.415313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:30.415520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:30.415948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:30.549262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:30.557699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-682c3ae4-afe7-466b-b263-22204dc982ea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.155718 Sep 26 17:59:30.576104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 163/307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:30 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:30.910120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:30.910676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:30.919550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:30.920128 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:30.925262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:30.925262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:30.925262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:30.925262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:31.095453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:31.103786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8e54f2d8-8a69-4482-9edc-af7b13773761 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.197481 Sep 26 17:59:31.104504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 145/308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:30 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:31.594917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c056eb-7a7d-425c-bca7-166be4ed38f0", "name": "network-vif-plugged", "status": "completed", "tag": "a57efb69-8445-44ce-a652-97961a863de6"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:31.595523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:31.597202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:31.621408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:31.625952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:31.625952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:31.625952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:31.626562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:31.626870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:31.627831 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:31.628733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:31.629589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:31.671480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] Creating event network-vif-plugged:a57efb69-8445-44ce-a652-97961a863de6 for instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 on hv-cinder-85931 Sep 26 17:59:31.684379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-6b0d4a7e-87b8-455c-a905-dc3256718a98 req-c3ad3640-f41b-46e3-a6b5-895f20e00e80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099652 Sep 26 17:59:31.685983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 146/309] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:31.799080 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:31.807433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a09a2310-d08d-4532-8fc4-2863e1609495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.228428 Sep 26 17:59:31.813033 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 164/310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:31 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:32.127815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:32.128617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:32.135181 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:32.135887 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:32.136331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:32.137100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:32.137659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:32.138253 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:32.291287 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:32.298980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5c452c97-0be4-47f8-8535-b85a43b7d7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.175992 Sep 26 17:59:32.299557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 147/311] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:32 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:32.838348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:32.838962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:32.844963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:32.845558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:32.845998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:32.846737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:32.847191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:32.847623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:33.003387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:33.020926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cd0961ea-1008-4ac4-af34-0d641a38a876 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.187427 Sep 26 17:59:33.022151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 165/312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:32 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:33.323315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:33.324769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:33.334610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:33.335325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:33.335998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:33.336519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:33.336885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:33.337733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:33.486942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:33.497725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-606dadf9-9d7d-4535-9351-abca4f0422f2 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1315 microversion: 2.1 time: 0.178823 Sep 26 17:59:33.498422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 148/313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:33 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:34.045267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:34.046043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:34.052268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.056766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.056766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.056766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.056766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.057503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.076202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:34.194577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:34.202369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ac98175e-7e36-4907-936a-8c16ac9e70a9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.161192 Sep 26 17:59:34.202935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 166/314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:34 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:34.528053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:34.528681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:34.535384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.535994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.536299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.537160 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.537823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.538520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.696794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:34.705621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e7e35efb-4c4a-4f12-9e57-39c11b899076 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1465 microversion: 2.1 time: 0.182409 Sep 26 17:59:34.706791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 149/315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:34 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:34.758428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:34.759135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:34.765751 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.766229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.766661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.767339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:34.767786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:34.768207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:34.792494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 17:59:35.122986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-80abcc04-a562-4903-b428-23edfc75d883 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 204 len: 0 microversion: 2.1 time: 0.368579 Sep 26 17:59:35.129926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 167/316] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 17:59:34 2022] DELETE /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 17:59:35.134604 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:35.135677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:35.150143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:35.150632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:35.151070 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:35.151889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:35.152646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:35.153066 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:35.229286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:35.235340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:35.241126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:35.241917 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:35.242553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:35.243654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:35.244164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:35.245579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:35.333778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:35.343776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-90251ea9-cb0e-4b0c-b305-05c51c69d221 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1471 microversion: 2.1 time: 0.213731 Sep 26 17:59:35.344776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 150/317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:35 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:35.412725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:35.422705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2de5b360-66eb-4893-b19b-5a6ff643d5ce tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.200137 Sep 26 17:59:35.423446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 168/318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:35 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:36.114631 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:36.115144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:36.121383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.121863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.122292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.122964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.123520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.123868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.149973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1b28678c-57d0-434d-b1ff-33d238fc95cc tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/ips" status: 200 len: 151 microversion: 2.20 time: 0.039241 Sep 26 17:59:36.157729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 151/319] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 17:59:36 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:59:36.372822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:36.372822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:36.375567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.376048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.376480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.377173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.377647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.378072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.448819 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:36.449642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:36.455904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.456680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.457333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.458128 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:36.458679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:36.459190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:36.581034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:36.595392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cfa6733a-96b7-473e-bcdf-7122c28bb119 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1471 microversion: 2.1 time: 0.230951 Sep 26 17:59:36.609659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 169/320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:36 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:36.631750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:36.639405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f581cc5d-c9a7-42a6-9279-f34cf9baa16f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.194824 Sep 26 17:59:36.639961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 152/321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:36 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:37.569516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:37.570813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:37.577095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.577848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.578469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.579351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.580238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.581574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.607858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-724b5ce3-e588-4226-93e1-3eb03dd93211 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/ips" status: 200 len: 145 microversion: 2.1 time: 0.042675 Sep 26 17:59:37.608465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 170/322] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 17:59:37 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:37.622804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:37.625369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:37.633945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.634645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.635257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.636119 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.636720 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.637328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.665508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:37.665508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:37.671986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.672258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.682139 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.683183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:37.683979 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:37.684552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:37.909170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:37.911497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:37.919456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2da3e509-5774-4505-b10c-8e8eaa26682a tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1471 microversion: 2.1 time: 0.300616 Sep 26 17:59:37.920036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 153/323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:37 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:37.945683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:37.955487 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d517d516-3750-4d9c-a8f4-6042434b125c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.296628 Sep 26 17:59:37.967288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 171/324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:37 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:38.092973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c056eb-7a7d-425c-bca7-166be4ed38f0", "name": "network-vif-deleted", "tag": "a57efb69-8445-44ce-a652-97961a863de6"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:38.107290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:38.107761 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:38.108183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:38.121692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] Creating event network-vif-deleted:a57efb69-8445-44ce-a652-97961a863de6 for instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 on hv-cinder-85931 Sep 26 17:59:38.127362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-68742d25-ca17-4cd9-90b4-5f3ad5446ac6 req-b7228a23-765e-448e-bd07-7571b0a5730a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038566 Sep 26 17:59:38.128534 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 154/325] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:38.945482 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:38.946789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:38.957115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:38.957115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:38.957115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:38.957115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:38.957577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:38.957577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:38.983430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:38.984818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:38.987971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:38.988461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:38.988949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:38.994848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lazy-loading 'fault' on Instance uuid a2c056eb-7a7d-425c-bca7-166be4ed38f0 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:59:38.998411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:38.998918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:38.999666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:39.001093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:39.001689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:39.002132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:39.033830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:39.043065 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8a082632-4eb9-4427-9a27-1cd13e64b7dd tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1305 microversion: 2.1 time: 0.101754 Sep 26 17:59:39.043752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 172/326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:38 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:39.154566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:39.162935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9685355b-21f9-4384-888a-f5d3f52c619a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.185326 Sep 26 17:59:39.163724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 155/327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:38 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:39.750882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:39.751420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:39.757716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:39.758403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:39.759197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:39.759957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:39.760419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:39.761000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:39.784704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lazy-loading 'flavor' on Instance uuid 9689462a-a796-4f06-b20f-00ba7a46cace {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:59:40.068555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:40.070513 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:40.078199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.078860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.079297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.080312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.080915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.081515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.116871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.117627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.118228 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.118836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lazy-loading 'fault' on Instance uuid a2c056eb-7a7d-425c-bca7-166be4ed38f0 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:59:40.166993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:40.174863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a0b9190c-1551-428a-a501-c3f546ebd043 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1305 microversion: 2.1 time: 0.111336 Sep 26 17:59:40.175509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 156/328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:40 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:40.190878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:40.191585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:40.197638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.198131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.198563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.199255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.199703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.209642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.372508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:40.381710 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b1dbc83c-7432-4f8a-b5f7-955e75e03299 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.194763 Sep 26 17:59:40.382881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 157/329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:40 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:40.422826 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-227fae98-d1c4-441e-938b-12fd26d46d55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/action" status: 202 len: 0 microversion: 2.20 time: 0.675756 Sep 26 17:59:40.426848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 173/330] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 17:59:39 2022] POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 17:59:40.432187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:40.432722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:40.439392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.439875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.440306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.441000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:40.441602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:40.442036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:40.574044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:40.582162 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:40.584247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:40.585442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-82f16764-688c-4640-b4de-6b7d56c0d016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.157569 Sep 26 17:59:40.586000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 158/331] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:40 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:41.199382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:41.200083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.206317 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.206802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.207239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.207928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.208413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.208843 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.250069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.250644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.251153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.251680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lazy-loading 'fault' on Instance uuid a2c056eb-7a7d-425c-bca7-166be4ed38f0 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 17:59:41.295473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c024ff310ff7443c90046e999a2dcaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b926bedb2ce44850b9a7ce09dc2f73ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:41.305644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-974e93cf-c8ea-4f91-a77b-2ec315fb11d8 tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 200 len: 1305 microversion: 2.1 time: 0.110368 Sep 26 17:59:41.306204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 174/332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:41 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:41.365588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92adca05-61a9-44b4-a8f6-99412924bae9"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:41.368510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.376547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.377042 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.377512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.378688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.379299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.379875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.410353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:41.411695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.425093 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.428379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.430473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.432097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.433094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.437163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.598473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:41.606246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aeda9c48-6ab1-4e54-a09b-63fc4684d60a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1502 microversion: 2.1 time: 0.203828 Sep 26 17:59:41.606804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 175/333] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:41 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:41.613839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:41.614444 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.625581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.626114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.627456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.627456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.627704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.628083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.765654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:41.774329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:41.775768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:41.777145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-10ee07f9-56ca-42c3-a82f-a5f12f143677 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.166777 Sep 26 17:59:41.777738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 176/334] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:41 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:59:41.786579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f1ed407-f24d-4658-8039-49da5a7628f0"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:41.790539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.796630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.797113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.797592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.798281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.798724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.799148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] HTTP exception thrown: Cannot 'attach_volume' instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 while it is in vm_state rescued Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Request method failure captured: Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/os-volume_attachments HTTP/1.1 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 74 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKNAjit7s3pSDX4eZsJuiExXyG9ODWhNqywnJvUzWbeIhOvLWYNNS1U26Kp05e7c-OIx67D5mGH0cCXXu8YGoJJQoCKGs6H03kBDsZCbgHDoy28bv2GsRi4j0ceA2pjH1qv85HSfImoJQAXxG1kvk6xkXz3ixMAcQZC8x1d-Prmn4 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:59:41.830808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/222cdd96fb334e63a823cab0d33f939f"}]}] Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0416809c467846428e7df9a7c11ffb0e Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {"volumeAttachment": {"volumeId": "8f1ed407-f24d-4658-8039-49da5a7628f0"}} Sep 26 17:59:41.832438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Cannot 'attach_volume' instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 while it is in vm_state rescued Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'server_id': 'de6a4239-37d1-4a0d-8d9d-35f96f93f7c1', 'body': {'volumeAttachment': {'volumeId': '8f1ed407-f24d-4658-8039-49da5a7628f0'}}} Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:59:41.833802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 while it is in vm_state rescued Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:59:41.835171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 while it is in vm_state rescued Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Returning 409 to user: Cannot 'attach_volume' instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 while it is in vm_state rescued {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5c937992-6887-46c4-8d1f-97e1c8ef75d6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046669 Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 177/335] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 17:59:41 2022] POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 17:59:41.836459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:41.837048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:41.841207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.841713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.842147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.842829 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:41.843283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:41.843706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:41.891410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:42.079032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cd661d04-1893-47fa-978a-6a9a84cfadea tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/action" status: 202 len: 0 microversion: 2.1 time: 0.248045 Sep 26 17:59:42.079884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 178/336] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 17:59:41 2022] POST /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 17:59:42.089425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:42.090124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:42.097021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.097543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.097971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.098666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.099165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.099593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.269603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:42.278292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d1a6c90f-2b8b-4c6a-b821-dc82fc370ca5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1510 microversion: 2.1 time: 0.193191 Sep 26 17:59:42.297195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 179/337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:42 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:42.330014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:42.330790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] [instance: a2c056eb-7a7d-425c-bca7-166be4ed38f0] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:42.345751 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.347203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.349647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.352486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.352940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.353401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.367403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] HTTP exception thrown: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Request method failure captured: Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 HTTP/1.1 Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMehyFD3xHYmqMjJN6xEBBvK5JYF3j5jppsj0tRG8WxX_UWVzUB3dtbelx41Lqu8frs7Cvmjjc4z-5LNNVX-_wJOnVAihdqy8BYKxEWjQyq_nxr7uJxvEe4LKDDJMrKS-kKgUV1WCOp-XoVaTCjquxxpo0SoT1a1u2BWVdQvMT6vo1zE Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: b926bedb2ce44850b9a7ce09dc2f73ff Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesNegativeTest-1679267135 Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 17:59:42.371842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b926bedb2ce44850b9a7ce09dc2f73ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b926bedb2ce44850b9a7ce09dc2f73ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b926bedb2ce44850b9a7ce09dc2f73ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b926bedb2ce44850b9a7ce09dc2f73ff"}]}] Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesNegativeTest-1679267135 Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: b926bedb2ce44850b9a7ce09dc2f73ff Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesNegativeTest-1679267135 Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesNegativeTest-1679267135-project Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: c024ff310ff7443c90046e999a2dcaf7 Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesNegativeTest-1679267135-project Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. Sep 26 17:59:42.373721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'a2c056eb-7a7d-425c-bca7-166be4ed38f0'} Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:59:42.374523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. Sep 26 17:59:42.375842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 17:59:42.377454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] Returning 404 to user: Instance a2c056eb-7a7d-425c-bca7-166be4ed38f0 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:59:42.377454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-65413861-9be8-4a0f-9aaf-2f1d1c4bc6bb tempest-VolumesNegativeTest-1679267135 tempest-VolumesNegativeTest-1679267135-project] 10.222.0.49 "GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0" status: 404 len: 111 microversion: 2.1 time: 0.045230 Sep 26 17:59:42.377454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 180/338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:42 2022] GET /compute/v2.1/servers/a2c056eb-7a7d-425c-bca7-166be4ed38f0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 17:59:42.804231 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:42.805199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:42.811184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.811793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.812325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.813124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:42.813702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:42.814249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:42.997678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:43.007210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:43.008664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:43.010166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b750ddaf-13df-4b81-9870-ce5c70034686 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.210663 Sep 26 17:59:43.011152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 181/339] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:42 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:59:43.113880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ad47ca85-044c-460d-88c6-bc06ca9c3c44 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.753406 Sep 26 17:59:43.116581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 159/340] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 17:59:41 2022] POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments => generated 194 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:43.303833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:43.304470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:43.310612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:43.315475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:43.315475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:43.315475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:43.315475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:43.316376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:43.457058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:43.466182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d49dbc82-dcd3-4506-9f45-7ebf0d435c94 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1510 microversion: 2.1 time: 0.167278 Sep 26 17:59:43.466857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 182/341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:43 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:44.036290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:44.037564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:44.044057 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:44.044541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:44.044988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:44.045716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:44.046161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:44.046587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:44.189216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:44.199373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:44.210279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:44.211102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3edd602a-4bd0-4621-87d2-e9ae0187fd7e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.179551 Sep 26 17:59:44.212002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 160/342] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:44 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:44.491024 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:44.491679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:44.498451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:44.498944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:44.499383 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:44.500086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:44.500538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:44.500965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:44.641673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:44.651378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ae52a310-dee4-474b-b74f-150bbd52b3fe tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1510 microversion: 2.1 time: 0.164827 Sep 26 17:59:44.652118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 183/343] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:44 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:45.236897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:45.237789 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:45.245610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:45.246177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:45.246677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:45.247474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:45.247991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:45.248485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:45.391910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:45.409123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:45.409123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:45.409123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9dbfc6bc-9e1d-4c4e-92a5-a37c2b034488 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.170233 Sep 26 17:59:45.409536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 161/344] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:45 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:45.682223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:45.683474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:45.694432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:45.695086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:45.697337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:45.698099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:45.699531 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:45.704673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:45.856713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:45.865194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aa52ffff-9702-4109-9113-01a5e6f76c2b tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1510 microversion: 2.1 time: 0.193409 Sep 26 17:59:45.865774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 184/345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:45 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:46.431019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:46.431679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:46.441443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:46.442329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:46.442949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:46.443803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:46.444422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:46.444993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:46.589389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:46.598021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:46.600080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:46.601357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ee81ccf0-7a94-4f7d-9de2-05908da7c8c9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.175239 Sep 26 17:59:46.602015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 162/346] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:46 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:46.888247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:46.888907 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:46.895523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:46.896512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:46.896951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:46.897703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:46.898160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:46.898592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:47.039585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:47.060876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7d75c460-dc1b-48c5-8106-3030afd9ebb0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1516 microversion: 2.1 time: 0.176524 Sep 26 17:59:47.061720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 185/347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:46 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:47.627419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:47.628060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:47.634995 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:47.635477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:47.635947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:47.636666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:47.637123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:47.637577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:47.765344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:47.773448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:47.774892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:47.776043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cda1b7d8-f0ac-439d-8d6b-0d8702cbeaab tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.152531 Sep 26 17:59:47.776592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 163/348] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:47 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:48.801883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:48.803149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:48.805419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:48.811113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:48.812027 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:48.812971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:48.813863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:48.814728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:48.815384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:48.987306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:48.987306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:48.988417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:48.990219 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4ee6e19f-f2d2-4df7-b7b9-a507e8effe18 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.191903 Sep 26 17:59:49.001896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 186/349] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:48 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:49.390211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c2c5a8d-e3aa-46fe-86e1-5e36bb672a1c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: .version_select at 0x7ff98216a160>, body: {"keypair": {"name": "tempest-keypair-621071442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7cSOnoVGAEg1VkoqFBRLL8wwOCBj9DDhx+PYV22JS3P7XjjPUF56qm48NRAIeM3WO5k0kB/SsOLwNuSGV9uh/pXAGn1ubaIbD71c8AypwHZdHjgl7qaOO5q/0zC2K64A=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:49.398211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:49.410323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-5c2c5a8d-e3aa-46fe-86e1-5e36bb672a1c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for project 222cdd96fb334e63a823cab0d33f939f. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:59:49.414767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-5c2c5a8d-e3aa-46fe-86e1-5e36bb672a1c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for user 0416809c467846428e7df9a7c11ffb0e and project 222cdd96fb334e63a823cab0d33f939f. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:59:49.602414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5c2c5a8d-e3aa-46fe-86e1-5e36bb672a1c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216392 Sep 26 17:59:49.602952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 164/350] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 17:59:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:50.016319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:50.017028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:50.023232 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:50.023712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:50.025397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:50.025397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:50.025397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:50.025666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:50.160342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:50.169353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:50.170789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:50.171937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d574d06d-5235-4c6e-8b45-b4151852d7cb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.159965 Sep 26 17:59:50.172479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 187/351] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:50 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:51.198638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:51.199438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:51.206960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:51.207448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:51.207880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:51.209149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:51.209671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:51.210863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:51.422201 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:51.431799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:51.433264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:51.434439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2e8f4c60-2542-431a-b365-4070b47bafad tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.240384 Sep 26 17:59:51.452231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 165/352] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:51 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:52.459878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:52.460621 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:52.468830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:52.469399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:52.469902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:52.471363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:52.472006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:52.472615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:52.625854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:52.627450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1569325280", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5c08d16-21cf-4774-99c2-a11d7b1a50a8"}], "security_groups": [{"name": "tempest-securitygroup--1447115932"}], "key_name": "tempest-keypair-621071442", "user_data": "}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:52.634549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:52.636217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:52.637442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3c049743-2d18-43b6-9f14-e05e9db2d721 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.182491 Sep 26 17:59:52.638509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 188/353] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:52 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:52.783738 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] validate_networks() for [('d5c08d16-21cf-4774-99c2-a11d7b1a50a8', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 17:59:53.168584 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 17:59:53.169065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 17:59:53.169575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 17:59:53.169985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 17:59:53.170447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 17:59:53.179841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:53.180318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:53.180754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:53.181509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:53.183415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:53.183415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:53.199219 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 17:59:53.204939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Getting quotas for user 0416809c467846428e7df9a7c11ffb0e and project 222cdd96fb334e63a823cab0d33f939f. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 17:59:53.216760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 17:59:53.219548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 17:59:53.365402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-46695b91-f77a-4cb0-880d-6c6c29a13a88 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.742432 Sep 26 17:59:53.367202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 166/354] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 17:59:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 17:59:53.378136 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-96e3dfe6-3649-4be9-9333-0dc46c64c000 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:53.378825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-96e3dfe6-3649-4be9-9333-0dc46c64c000 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:53.435485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-96e3dfe6-3649-4be9-9333-0dc46c64c000 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:53.443458 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-96e3dfe6-3649-4be9-9333-0dc46c64c000 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1245 microversion: 2.1 time: 0.069350 Sep 26 17:59:53.444107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 189/355] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:53 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:53.681860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:53.682399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:53.692414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:53.693057 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:53.693585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:53.694276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:53.697696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:53.697696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:53.922345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:53.933808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:53.934396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:53.935561 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e890305f-23c1-4c00-a3c3-acaad832759f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.263123 Sep 26 17:59:53.936172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 167/356] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:53 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:54.029601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:54.030791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:54.038669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:54.051217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:54.051217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:54.051217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:54.051217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:54.051657 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:54.072891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-092b6f55-c2d3-47d1-a017-8223e7a1ef69 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/ips" status: 200 len: 148 microversion: 2.1 time: 0.048713 Sep 26 17:59:54.080694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 190/357] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 17:59:54 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/ips => generated 148 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:54.470953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e8f49d76-9163-44b3-9e77-37164c8b9841 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:54.471808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e8f49d76-9163-44b3-9e77-37164c8b9841 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:54.547240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e8f49d76-9163-44b3-9e77-37164c8b9841 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:54.554313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e8f49d76-9163-44b3-9e77-37164c8b9841 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1245 microversion: 2.1 time: 0.087558 Sep 26 17:59:54.554997 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 168/358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:54 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:54.962250 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:54.962887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:54.968833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:54.969376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:54.969824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:54.970511 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:54.970967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:54.971396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:55.100141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:55.108746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:55.110359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:55.111515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cbe39c2b-f6ac-4f0b-abea-a3e7b12acbe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.153906 Sep 26 17:59:55.112093 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 191/359] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:54 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:55.589484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:55.590293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:55.606876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:55.608179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:55.609754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:55.610643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:55.611913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:55.613009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:55.628824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:55.635470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:55.636141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:55.636749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:55.711736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Going to try to stop instance {{(pid=132949) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 17:59:55.715955 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:55.726219 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-93179f47-8527-4da6-acbf-94fc983b8a40 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1241 microversion: 2.1 time: 0.151890 Sep 26 17:59:55.726809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 169/360] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:55 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:55.890119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d9eee2fe-4f08-462f-8ed5-ff25a51ea70f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action" status: 202 len: 0 microversion: 2.1 time: 0.264830 Sep 26 17:59:55.890995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 192/361] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 17:59:55 2022] POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 17:59:55.902747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:55.902747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:55.914715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:55.918504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:55.918504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:55.918504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:55.918504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:55.918945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:56.063938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:56.073111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-66678d5b-ada7-432a-ac7b-d677dd5ce6e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.177124 Sep 26 17:59:56.073705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 170/362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:55 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:56.138010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:56.141949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:56.144728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:56.145299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:56.145736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:56.146430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:56.146881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:56.147302 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:56.280577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:56.294918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:56.296625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:56.298232 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5650c544-8b6e-485e-8f1f-08ebebfdb57c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.164504 Sep 26 17:59:56.299394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 193/363] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:56 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:56.750891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:56.751516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:56.758011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:56.758540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:56.758978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:56.759666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:56.762348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:56.762348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:56.827878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:56.837142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-134dd883-8589-4b51-a3e2-74ab74be36d7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1297 microversion: 2.1 time: 0.090341 Sep 26 17:59:56.837752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 171/364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:56 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:57.008858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "364eb9ca-f439-48db-999b-80280d36a062"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:57.014364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:57.020669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.021172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.022427 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.022427 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.022787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.023218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.097869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:57.098705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:57.105847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.106359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.106838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.107717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.108167 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.108589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.111583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:57.246568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:57.254712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-33c150be-7247-4edc-9866-cb52c67358e6 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.161076 Sep 26 17:59:57.255386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 172/365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:57 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:57.328285 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:57.329268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:57.335901 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.336674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.337303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.338077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.338785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.339206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.518639 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:57.533543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:57.536493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:57.538456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-632eeb8d-3a0f-459d-a03c-470110c6ca67 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.215221 Sep 26 17:59:57.541354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 173/366] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:57 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:59:57.861017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:57.862582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:57.876115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.876115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.876115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.876115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:57.876532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:57.876532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:57.939953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:57.948490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:57.956018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1cfd9755-b276-440e-ae0b-733a8261b866 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1303 microversion: 2.1 time: 0.099921 Sep 26 17:59:57.956586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 174/367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:57 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:59:58.050731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-62f67e4e-bcff-45b6-a426-3aa81f26f066 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045877 Sep 26 17:59:58.057625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 194/368] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 17:59:57 2022] POST /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:58.279135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:58.279872 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:58.300368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.300857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.301313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:58.302015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.302460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.303461 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:58.458732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:58.468894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-36a48d8c-0d18-4642-bf99-9d51bc39acab tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.193831 Sep 26 17:59:58.469528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 175/369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:58 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:58.565096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:58.565816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:58.572003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.572882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.573455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:58.574261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.574913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.575433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:58.736667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:58.744676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:58.746155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:58.747318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3131cca7-714f-45b9-a48c-0d235ef0da99 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.187005 Sep 26 17:59:58.747860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 195/370] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:58 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:59:58.982648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:58.983265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:58.998497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.998497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.998497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:58.998497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:58.999020 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:58.999020 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:59.164192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:59.181575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4ce56588-e4b5-4e71-98d3-8b7ee57fe5f5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.204685 Sep 26 17:59:59.193758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 176/371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:58 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:59.406201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:59:59.421473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:59.421473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:59.421473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:59.430756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] Creating event network-changed:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 17:59:59.435739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-763887a3-5a13-4ebd-86cb-7e0a56483325 req-f3554703-ba75-4624-b9b8-093d1ac95d04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Sep 26 17:59:59.436449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 196/372] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 17:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:59:59.499132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:59.499850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:59.506970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:59.513782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:59.513782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:59.513782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:59.513782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:59.514148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:59.668868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 17:59:59.675084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-be8bc1c3-4b4f-407a-a352-edbb175aa475 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.182118 Sep 26 17:59:59.675853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 177/373] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 17:59:59 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:59:59.773386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:59:59.774086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 17:59:59.780720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:59.781997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:59.781997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:59:59.782326 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:59:59.782945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:59:59.783364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:00.208295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:00.210394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:00.229816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:00.231776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:00.231776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:00.238782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:00.239269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:00.239708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:00.239932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:00.252878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:00.255772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:00.260517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fb016313-cdd7-4902-ba75-2a3da63a1b55 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.490772 Sep 26 18:00:00.262123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 197/374] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 17:59:59 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:00.427252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:00.439751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b0b930ce-7365-40b0-849e-ea7c1bf6f09c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.235614 Sep 26 18:00:00.457376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 178/375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:00 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:00.712904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:00.713682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:00.720356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:00.720837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:00.721294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:00.721981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:00.722434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:00.722860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:00.872220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:00.881368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-134fd141-38e5-4967-b7c0-2d6005ca7a49 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.185667 Sep 26 18:00:00.881954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 198/376] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:00 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:01.288728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:01.289371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:01.295931 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.296419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.296882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:01.297765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.298212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.298646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:01.444504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:01.453072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:01.454523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:01.455703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eecada0f-0579-4b46-a6cd-edb2b408de3d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.171699 Sep 26 18:00:01.456250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 179/377] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:01 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:01.469640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:01.476192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:01.477549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.478036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.478476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:01.479242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.479773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.480196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:01.611756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:01.620332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5ac72613-f29e-40c6-8f55-987fb40fd26c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.155123 Sep 26 18:00:01.621008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 199/378] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:01 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:01.907085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:01.908661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:01.915800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.916583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.917417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:01.918148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:01.918992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:01.919426 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:02.073775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:02.085977 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-371159bf-4ea3-4652-a4fe-89a933d9bf4d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.184082 Sep 26 18:00:02.086756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 180/379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:01 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:02.486649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:02.487976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:02.501985 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:02.502556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:02.502984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:02.503671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:02.504116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:02.504729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:02.643279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:02.643937 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:02.656286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:02.658360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:02.659717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:02.660335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:02.661270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:02.661900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:02.662522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:02.664943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:02.668787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:02.668787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c8eb89ee-32be-424f-900f-c64f7f47a469 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.186151 Sep 26 18:00:02.668787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 200/380] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:02 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:02.839777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:02.854060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c818517e-7c17-4256-a62a-e06fa43f3aaa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.214980 Sep 26 18:00:02.866416 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 181/381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:02 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:03.113654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:03.114361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:03.124039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.124039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.124039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.124039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.124500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.124500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.285540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:03.295393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0f913d7f-21e7-44c7-b326-7ead82912d3b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.185481 Sep 26 18:00:03.296933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 201/382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:03 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:03.700388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:03.706963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:03.706963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:03.713857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.714365 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.715134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.715883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.716510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.717135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.872849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:03.878509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:03.879155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:03.879358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:03.881812 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:03.881944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:03.882996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-25e514de-aa02-4bac-b0d0-6bd8c7b36eed tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1744 microversion: 2.20 time: 0.190770 Sep 26 18:00:03.890920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.891652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.892085 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.893329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:03.894071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:03.894641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:03.897737 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 182/383] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:03 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:04.090653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:04.100832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2d33042f-e542-4bb2-bb6c-459edf7f7e6f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.226218 Sep 26 18:00:04.103435 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 202/384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:03 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:04.320443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:04.321069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:04.329454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:04.329949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:04.330391 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:04.331099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:04.331554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:04.332210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:04.551779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=12 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:04.567099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:04.579649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-99d15f15-ef96-499a-a035-8edd9352ef3c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.264139 Sep 26 18:00:04.583071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 183/385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:04 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:04.913696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:04.914331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:04.922082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:04.922650 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:04.923178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:04.923958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:04.924415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:04.924838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:04.945490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "name": "network-vif-plugged", "status": "completed", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:04.957395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:04.957895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:04.958331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:04.973338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] Creating event network-vif-plugged:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 18:00:04.980293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-fc2dea1f-3291-4fa5-b698-6b76adf3b223 req-66831125-314e-411d-8463-b4dd134edc33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038935 Sep 26 18:00:04.981650 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 184/386] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:00:05.127878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:05.130543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:05.136928 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:05.138420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:05.139022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:05.139904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:05.140505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:05.141076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:05.181028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:05.194497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:05.196294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:05.197715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cafe7a2b-8731-417e-b0d4-b0f2b390ae2f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1744 microversion: 2.20 time: 0.289457 Sep 26 18:00:05.198430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 203/387] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:04 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:05.381728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:05.389329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c48ea5f8-9610-4335-8afb-16e3f24aba5a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.266433 Sep 26 18:00:05.390211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 185/388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:05 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:05.609149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:05.609875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:05.618548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:05.619706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:05.620311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:05.621184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:05.621849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:05.622436 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:05.817739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:05.827148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4d135287-d7a4-4c6d-8360-a8d653d7ed7c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.222806 Sep 26 18:00:05.841595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 204/389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:05 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:06.227527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:06.228875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:06.236921 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.237815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.238596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.245453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.245453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.245453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.414801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:06.417007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:06.432911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.435670 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.436355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.437340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.438021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.438689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.541884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:06.551453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:06.554237 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:06.560117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8fea4b59-cd90-429a-9d0f-5e5b083ee48d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1744 microversion: 2.20 time: 0.339363 Sep 26 18:00:06.565528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 186/390] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:06 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1744 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:06.696580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:06.717405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-989d2908-27b9-422b-ae42-e4279ab323d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.307198 Sep 26 18:00:06.717990 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 205/391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:06 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:06.855447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:06.856076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:06.862389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.862869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.863545 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.864557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:06.865436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:06.870898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:06.873040 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7b84e05f-57e2-4268-90e6-b94bb422001b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: .version_select at 0x7ff981e6ddc0>, body: {"keypair": {"name": "tempest-keypair-1423628835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/DaEMFy+xd8QtEiVNfuG5MlCPeTbbqs73f5f0rT/U8Ns1qiK0Y+DEXEbZxaSveLKzihPC64gSvxYvhkoEKFFDsPiZB+RUu8PXh58IjqNZNYFUOD7IClr6Y+zzqFyvnlw=="}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:06.900270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-7b84e05f-57e2-4268-90e6-b94bb422001b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:00:06.905036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-7b84e05f-57e2-4268-90e6-b94bb422001b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:00:07.025988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7b84e05f-57e2-4268-90e6-b94bb422001b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157317 Sep 26 18:00:07.027959 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 206/392] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:00:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:07.061267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:07.071816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-04d72dda-54d9-4b35-81ae-93d99e7c8788 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.224502 Sep 26 18:00:07.073204 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 187/393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:06 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:07.596186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:07.596846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:07.603099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:07.603523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:07.603998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:07.604921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:07.605555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:07.606767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:07.741476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:07.742661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:07.749410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:07.749904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:07.750349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:07.751052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:07.751508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:07.751935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:07.808288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:07.817318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:07.819678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:07.820902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dd131a46-c535-48e7-92ae-ed3ce2af6d2e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1744 microversion: 2.20 time: 0.229151 Sep 26 18:00:07.822222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 207/394] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:07 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:07.949686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:07.960765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-11a65924-b60c-43ea-b438-a4b0f6387e58 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1371 microversion: 2.1 time: 0.224275 Sep 26 18:00:07.977854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 188/395] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:07 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:08.101000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:08.102799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:08.109325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.110057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.111140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.112068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.112708 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.113341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.285490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:08.294321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-865c7f62-9e1d-4bbc-9c99-62aeb787e60b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.201059 Sep 26 18:00:08.294887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 208/396] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:08 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:08.677683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "name": "network-vif-plugged", "status": "completed", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:08.687556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.688500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.689189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.706633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] Creating event network-vif-plugged:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 18:00:08.713279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-79b22ae2-69e4-484a-8433-0b969b387e51 req-73fd7097-0144-4b72-9a26-4034efa4622f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039780 Sep 26 18:00:08.714543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 189/397] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:08.847680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:08.847680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:08.855873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.856743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.857443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.858411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.859115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.860022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.985024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:08.985746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:08.996465 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.997592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:08.998267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:08.999243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:08.999848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:09.000472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:09.007250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:09.011505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:09.021170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:09.023570 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:09.024978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-31f8807c-7c9d-48bc-ae8b-b264b01633dd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.183245 Sep 26 18:00:09.037393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 209/398] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:08 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:09.183258 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:09.191247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1798da2e-3bc6-40e9-9515-ef7d6bcbd803 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1565 microversion: 2.1 time: 0.210929 Sep 26 18:00:09.194257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 190/399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:08 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:09.226207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:09.226713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:09.235454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:09.236281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:09.236888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:09.237794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:09.238407 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:09.239137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:09.319000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:09.319775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:09.328488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:09.329822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:09.332100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:09.332975 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6e47564c-3aba-4a15-94fd-00d3582c7ac1 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112484 Sep 26 18:00:09.333107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:09.333509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:09.342413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 210/400] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:00:09 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:00:09.343436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:09.542205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:09.551680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7666452c-47b3-4662-8abe-2f9b6744bcb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.237171 Sep 26 18:00:09.552282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 191/401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:09 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:10.054152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:10.055388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:10.061514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:10.061996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:10.062425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:10.063116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:10.063559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:10.069419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:10.281723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:10.291039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:10.292759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:10.294221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cb8a2b0f-a17a-4604-a4fb-14df1e416e1d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.244539 Sep 26 18:00:10.308419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 211/402] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:10 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:10.582547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:10.584801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:10.601175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:10.601958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:10.602540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:10.603435 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:10.604333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:10.605862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:10.904455 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:10.923330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7df05d8e-5eb3-49e4-98b7-249c7bd56964 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.350860 Sep 26 18:00:10.930155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 192/403] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:10 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:11.092441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-904698086", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c4905c3-b6d4-4b95-988f-f86fad27c092"}], "security_groups": [{"name": "tempest-securitygroup--1017356528"}], "key_name": "tempest-keypair-1423628835", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:11.322362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:11.323968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:11.330067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:11.330626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:11.331063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:11.331750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:11.332195 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:11.332614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:11.501656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:11.511785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:11.513456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:11.514678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bd6d843d-cce6-4fc6-a2a0-f451cb2167c1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.196769 Sep 26 18:00:11.515246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 193/404] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:11 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:11.956663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:11.957739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:11.964681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:11.965129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:11.965675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:11.966373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:11.966839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:11.969916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:12.157290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:12.166766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-419813f5-d8a6-4acf-a13a-ba11bd4bc764 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.214475 Sep 26 18:00:12.173401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 194/405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:11 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:12.266764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:12.276479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:12.276955 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:12.277698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:12.291394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] Creating event network-changed:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 18:00:12.296337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-53c03ed3-0934-4dfa-b75b-4081bbfa33c4 req-0704ad33-7c31-4b4e-87d0-a87452444ddd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033263 Sep 26 18:00:12.297106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 195/406] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:00:12.542643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:12.543707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:12.555895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:12.564590 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:12.568967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:12.571045 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:12.571752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:12.572425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:12.729984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:12.739343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:12.740907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:12.742229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bd1fc050-e429-41f5-abf1-1e4bd17a706d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.205827 Sep 26 18:00:12.742965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 196/407] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:12 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:13.190325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:13.190924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:13.197498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:13.198270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:13.198713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:13.199828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:13.200227 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:13.200744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:13.356491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:13.382568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dd63472c-1669-4da2-a7f9-dde09c57c439 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.181983 Sep 26 18:00:13.382568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 197/408] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:13 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:13.769742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:13.776503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:13.783933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:13.784678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:13.785310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:13.786954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:13.787588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:13.788165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:14.069551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:14.083098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:14.088665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:14.088665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-66e2261a-d34a-475b-b7a9-c0e700682501 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.321451 Sep 26 18:00:14.088665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 198/409] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:13 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:14.404678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:14.405546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:14.411658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:14.412193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:14.413125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:14.414015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:14.414689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:14.415388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:14.647988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:14.657876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-61ba1649-e55f-49a1-a81e-1ae4ab8c3f05 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.257547 Sep 26 18:00:14.661054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 199/410] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:14 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:15.027606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] validate_networks() for [('5c4905c3-b6d4-4b95-988f-f86fad27c092', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:00:15.114913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:15.115638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:15.119782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:15.124800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.125463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.125907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.126916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.127371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.127803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.391639 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:15.400534 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:15.402123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:15.404677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fee65275-62a9-4af4-a4cd-f5551a8a7730 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.294713 Sep 26 18:00:15.405599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 200/411] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:15 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:15.685267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:15.686069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:15.692494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.692962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.693954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.694654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.695113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.695562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.735711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:00:15.735711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:00:15.735711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:00:15.735711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:00:15.735711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:00:15.739247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.739723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.740158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.740869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:15.741376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:15.741802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:15.758942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:00:15.762967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:00:15.774708 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:00:15.777003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:00:15.869054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:15.877291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-304cb779-aad6-40fd-a1d7-ffba6cb37896 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.196032 Sep 26 18:00:15.877861 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 201/412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:15 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:16.029150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-88c536d1-4db4-480a-8b0d-497e64555c04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.941260 Sep 26 18:00:16.037067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 212/413] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:00:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 4950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:00:16.045684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b7b4fa60-f531-4e31-980b-98919280350d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:16.057905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b7b4fa60-f531-4e31-980b-98919280350d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:16.180936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b7b4fa60-f531-4e31-980b-98919280350d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:16.187834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b7b4fa60-f531-4e31-980b-98919280350d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1241 microversion: 2.1 time: 0.147162 Sep 26 18:00:16.193855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 202/414] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:16 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:16.442310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:16.445007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:16.453127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:16.454430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:16.455541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:16.456858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:16.457578 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:16.458384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:16.790377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:16.811748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:16.811748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:16.811748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-45699139-2389-44cb-b76e-6397e4c6859a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.370306 Sep 26 18:00:16.812811 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 213/415] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:16 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:16.908497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:16.928387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:16.936611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:16.941279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:16.941808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:16.942794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:16.943935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:16.945944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:17.158954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:17.168460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9de3f7cd-2ab6-405c-a111-49bbc7beb50b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.267674 Sep 26 18:00:17.169041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 203/416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:16 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:17.227625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-79448d0a-12a2-439a-8961-f82d2e7a524f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:17.228249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-79448d0a-12a2-439a-8961-f82d2e7a524f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:17.300861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-79448d0a-12a2-439a-8961-f82d2e7a524f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:17.310018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-79448d0a-12a2-439a-8961-f82d2e7a524f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1241 microversion: 2.1 time: 0.089110 Sep 26 18:00:17.317733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 214/417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:17 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:17.843268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:17.843953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:17.852733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:17.853370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:17.854079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:17.855050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:17.855686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:17.856341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:18.047345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:18.077719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:18.086156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:18.089388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-50da004d-59a4-4a1b-a375-690072bb882d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.250226 Sep 26 18:00:18.103110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 204/418] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:17 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:18.201904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:18.202563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:18.215438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:18.216469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:18.216779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:18.217575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:18.218444 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:18.221387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:18.229404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:18.333143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:18.334739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:18.346720 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:18.347512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:18.348968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:18.350567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:18.351268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:18.353200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:18.497152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:18.500866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:18.514377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3017bb0c-04a9-4f1c-a180-fd2a5b2c494d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.325997 Sep 26 18:00:18.515306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 215/419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:18 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:18.558274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ba068711-42d4-44aa-a61c-1a2825d7fdb8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1293 microversion: 2.1 time: 0.229180 Sep 26 18:00:18.558968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 205/420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:18 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1293 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:19.129246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:19.129246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:19.171013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.171981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.172610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.173530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.174171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.174750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.441337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:19.450529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:19.452294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:19.453642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-784f03ab-33d2-4601-81b6-3de6f33eeab5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.331852 Sep 26 18:00:19.454496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 216/421] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:19 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:19.540717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:19.542231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:19.551411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.565891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.569469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.570869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.571572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.574113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.582579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:19.583275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:19.593143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.599352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.599352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.599352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:19.599352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:19.600323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:19.790887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:19.798752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a42eaca7-9dda-4086-8d2e-bfe1c1ecce3b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1293 microversion: 2.1 time: 0.220421 Sep 26 18:00:19.799334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 217/422] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:19 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1293 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:19.930612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:19.939695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-da70f720-4b17-4df2-9f2d-048d1add4168 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.402972 Sep 26 18:00:19.946353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 206/423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:19 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:20.482649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:20.483202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:20.493817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:20.499086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:20.499724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:20.500463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:20.501128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:20.501784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:20.836308 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:20.847055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:20.862189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:20.863291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:20.866885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:20.868654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:20.871819 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:20.875805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:20.948331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:20.974572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:20.979125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:20.982615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-42148c30-7410-48e2-86e8-d59e2e32738b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.506093 Sep 26 18:00:21.001978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 218/424] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:20 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:21.017794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:21.020414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:21.036342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:21.037100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:21.037806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:21.039115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:21.039799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:21.040840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:21.048547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:21.059654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d672ca65-24c3-4628-9bf2-4749ba0fba91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1299 microversion: 2.1 time: 0.227850 Sep 26 18:00:21.063552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 207/425] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:20 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:21.350661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:21.364792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-458e8c1b-d451-4656-85c0-3cdc2963067d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.362096 Sep 26 18:00:21.364792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 219/426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:20 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:22.016172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:22.017612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:22.028873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.030798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.032844 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.033783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.035064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.037361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.075170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:22.091127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:22.092406 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:22.114049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.115154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.115839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.117899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.118981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.120284 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.550377 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:22.564638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:22.566480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:22.572482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-406c855e-f68c-400e-ae75-184a58e2c3b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.561025 Sep 26 18:00:22.589638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 208/427] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:22 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:22.600619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:22.602062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:22.608713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.609421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.610032 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.610905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:22.611752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:22.612891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:22.640041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:22.654269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-20a22a25-6ab7-4951-bb69-cd087451380f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.557673 Sep 26 18:00:22.655218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 220/428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:22 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:22.843540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:22.854078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-58bdeea5-8244-4b99-98f7-42da1914484e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.263350 Sep 26 18:00:22.855238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 209/429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:22 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:23.305472 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9a9e8a-7083-4630-b3a3-f06226a6b58f", "tag": "16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:23.325677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:23.332121 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:23.337023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:23.346169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:23.376979 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] Creating event network-changed:16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786 for instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f on hv-cinder-85931 Sep 26 18:00:23.389297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-e969c8cb-a615-4440-a823-fc09480fe72b req-fb89b7b9-045e-4880-8403-e5643c648cfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089484 Sep 26 18:00:23.391331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 221/430] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:23.640449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:23.640449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:23.640449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:23.640449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:23.641301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:23.641301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:23.641301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:23.641301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:23.685619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:23.686340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:23.706454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:23.706963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:23.707410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:23.708137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:23.708598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:23.709100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:24.153470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:24.173481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:24.174933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:24.176111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ccd8c1d8-0be0-4e54-af79-f150fb98318c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.576662 Sep 26 18:00:24.182655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 210/431] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:23 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:24.201378 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:24.207769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:24.222703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:24.223474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:24.227656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:24.228613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:24.229263 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:24.229852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:24.261662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:24.273550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-44f9dc9b-e63d-4cc3-9ad6-df19afc6d002 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.592176 Sep 26 18:00:24.290252 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 222/432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:23 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:24.553581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:24.584735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-799bde2f-9e9c-4d57-8fb9-2e5e5a55cbb0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.400187 Sep 26 18:00:24.585335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 211/433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:24 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:25.204096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:25.205440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:25.219991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.226484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.228012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.233624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.236239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.238729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.297888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:25.298496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:25.315388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.322285 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.323270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.324310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.325030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.325664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.576026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:25.588171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:25.592703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:25.595042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-378a37dc-fea9-47b9-9712-96f48c5d6965 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.394771 Sep 26 18:00:25.617091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 223/434] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:25 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:25.623411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:25.624415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:25.631727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.632567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.633377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.634333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:25.635044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:25.635695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:25.724069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:25.737758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e7ed0e98-6549-4d64-ba40-c4a6a4e5c94f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.440690 Sep 26 18:00:25.741850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 212/435] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:25 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:25.750215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:26.075454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:26.075454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b8729578-35e5-41c4-916f-a282c4b21c56 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1721 microversion: 2.1 time: 0.326312 Sep 26 18:00:26.075454 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 224/436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:25 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:26.624254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:26.625591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:26.631591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:26.634221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.635176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.635337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:26.636303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.644825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.644825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:26.765152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:26.765984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:26.784532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.785772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.789470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:26.790592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.793631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.796197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:26.915993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:26.929782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:26.932245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:26.937398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-71ca8c37-625d-42c8-9edc-894feec4c8e3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.316663 Sep 26 18:00:26.940733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 213/437] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:26 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:26.968472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:26.969621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:26.979203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.980071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.982196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:26.986757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:26.986757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:26.986757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:27.060598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:27.077213 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6c018fff-dc51-4579-8624-80156639ec6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.317997 Sep 26 18:00:27.080943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 225/438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:26 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:27.283525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:27.301397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-632e488c-77a5-4253-b797-b1f92407a791 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1698 microversion: 2.1 time: 0.336941 Sep 26 18:00:27.302823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 214/439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:26 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1698 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:27.332071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:27.345269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=12 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:27.348303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:27.349042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:27.349728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:27.392481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Going to try to start instance {{(pid=132949) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 18:00:27.658667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-769d3248-9fd5-4854-9f41-38fbcfcda63c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action" status: 202 len: 0 microversion: 2.1 time: 0.331935 Sep 26 18:00:27.660363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 226/440] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:00:27 2022] POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:00:27.670151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:27.671471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:27.696557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:27.696557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:27.696557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:27.696557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:27.697321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:27.699586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:27.970244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:27.971039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:27.988516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:27.989563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:27.990160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:27.991263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:27.996294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:27.999938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:28.000905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:28.011795 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b3bab598-728c-4002-b57d-83651003301f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1707 microversion: 2.1 time: 0.346410 Sep 26 18:00:28.012903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 215/441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:27 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1707 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:28.106855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:28.107760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:28.114459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:28.119271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:28.119735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:28.120468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:28.121280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:28.121717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:28.470205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:28.476980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:28.480745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:28.484544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f7b373b7-50c2-499a-97bd-c6702cb3d2db tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.519123 Sep 26 18:00:28.487895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 227/442] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:27 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:28.532288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:28.545101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5a88b1a6-6c58-4efa-b78a-f26c1b08ca07 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.442774 Sep 26 18:00:28.549442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 216/443] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:28 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:29.041627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:29.042351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:29.059736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.060241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.060689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.064312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.064804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.065269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.270826 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:29.282553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d7d450aa-80d2-497c-abad-393057140bd1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1707 microversion: 2.1 time: 0.245905 Sep 26 18:00:29.285882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 228/444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:29 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1707 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:29.515062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:29.517837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:29.532788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.534144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.535043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.535933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.536939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.537589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.575746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:29.576149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:29.592031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.592837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.593362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.594222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:29.595793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:29.595793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:29.886065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:29.896664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:29.902992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:29.904147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:29.904657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-278bc1d9-0fce-45c3-8343-6b4dcfe35ea0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.393239 Sep 26 18:00:29.905753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 217/445] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:29 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:29.933524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1ca4a14f-1e26-43ad-aa08-412ac3d37b6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.362449 Sep 26 18:00:29.934687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 229/446] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:29 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:30.314215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:30.314857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:30.321842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.322320 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.322746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:30.323597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.324056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.324502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:30.532331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:30.541632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e48f4c0a-7e0f-4a8d-85b5-b3d4d5b020c3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1707 microversion: 2.1 time: 0.232933 Sep 26 18:00:30.553248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 218/447] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:30 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1707 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:30.934951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:30.935555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:30.941908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.942381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.942808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:30.943486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.944705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.945125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:30.957711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:30.958363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:30.965473 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.965961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.966406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:30.967096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:30.967548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:30.968046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:31.152702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:31.160752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:31.163408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:31.164576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-34d3673f-1e78-4c45-852a-93b3d916359e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.233628 Sep 26 18:00:31.164869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:31.165129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 230/448] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:30 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:31.172834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-48c00522-677f-4a83-b17d-7306d930897a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.219017 Sep 26 18:00:31.173444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 219/449] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:30 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:31.565941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:31.566598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:31.572935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:31.573463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:31.573904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:31.574598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:31.575056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:31.575488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:31.593814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:31.710775 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:31.718516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b9466fff-5f67-4ac6-9890-94b20050ff37 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1711 microversion: 2.1 time: 0.156427 Sep 26 18:00:31.719104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 231/450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:31 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:32.198657 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:32.199386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:32.200122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:32.200728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:32.210263 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:32.219682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:32.221215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:32.222160 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:32.222929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:32.229104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:32.229630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:32.230247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:32.230849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:32.231744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:32.237963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:32.238803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:32.796359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:32.809654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:32.815430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:32.815577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:32.815577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6a8290c3-7088-4dde-8ffb-4bc1cda284a4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.624337 Sep 26 18:00:32.821642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 220/451] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:32 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:32.823304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b976c747-1941-4258-b8ea-7e6e5cc37d91 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.630536 Sep 26 18:00:32.824027 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 232/452] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:32 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:33.855512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:33.857285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:33.858323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:33.860201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:33.870854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:33.871339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:33.871804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:33.872504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:33.872947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:33.873399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:33.878953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:33.879434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:33.879863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:33.880556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:33.880999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:33.882061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:34.149962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:34.153302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:34.163206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:34.164698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4800e8f9-0d06-4863-98fc-b0bfc606eb62 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.317412 Sep 26 18:00:34.165641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 221/453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:33 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:34.168252 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:34.169748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6648f137-0bbb-4107-b932-ab952b59780f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.319302 Sep 26 18:00:34.170554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 233/454] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:33 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:35.187946 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:35.188579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:35.195882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:35.196370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:35.196803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:35.197539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:35.197647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:35.198169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:35.198264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:35.198396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:35.204697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:35.205184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:35.205656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:35.206383 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:35.206882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:35.207302 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:35.387758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:35.395783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-902bf060-27f0-4f5a-90e6-e860ad66e93f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.211684 Sep 26 18:00:35.396352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 222/455] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:35 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:35.411627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:35.420782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:35.422699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:35.424298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f3a57014-9e10-4347-ba03-3ec0e9539c74 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1739 microversion: 2.20 time: 0.231105 Sep 26 18:00:35.424947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 234/456] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:35 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:36.177500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-57d90b92-27ca-4d7d-9e99-8f825b1add54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'create', calling method: .version_select at 0x7ff98207dc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-278174934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrxFvLUDZlDFkoKUiac65eRBqZ3+FNZMm7L1U+4RO4MXQAME8uWUh1bhnE68VERp6l9PWPaQC6tW4NdQnG/LPqeJM8EQbYQB5lKMdomBCaUF+p7eY6u0r5mrrlBgVcEg=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:36.193564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-57d90b92-27ca-4d7d-9e99-8f825b1add54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Getting quotas for project df8e59bd01c64c8f8d7302ff01bba771. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:00:36.197927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-57d90b92-27ca-4d7d-9e99-8f825b1add54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Getting quotas for user 0f74dd694d7f4f999130294e1f8828d7 and project df8e59bd01c64c8f8d7302ff01bba771. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:00:36.287754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-57d90b92-27ca-4d7d-9e99-8f825b1add54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114149 Sep 26 18:00:36.288373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 223/457] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:00:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:36.340460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1666274036", "imageRef": "3a3ac027-ab88-45df-893f-73c3e4187c0e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-278174934", "networks": [{"uuid": "b20afce1-7503-4697-8dda-6e5a130f7a27"}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:36.391704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] validate_networks() for [('b20afce1-7503-4697-8dda-6e5a130f7a27', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:00:36.420168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:36.420934 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:36.427956 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.428665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.429107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.429843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.430298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.430875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.628528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:36.636857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3cb792c4-f8dc-480f-8bdf-5867e82e877a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.220732 Sep 26 18:00:36.637470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 224/458] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:36 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:36.642348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:36.642960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:36.655069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.655724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.656165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.656868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.657349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.657776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.868359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:36.876496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:36.877998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:36.879158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2a55f1d5-d260-4aa9-879f-3b5297115468 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1721 microversion: 2.20 time: 0.240772 Sep 26 18:00:36.879717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 225/459] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:36 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:36.884746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "name": "network-vif-unplugged", "status": "completed", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:36.894117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.894601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.895036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.897702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:36.907819 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:00:36.911237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:00:36.911237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:00:36.911440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] Creating event network-vif-unplugged:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 18:00:36.911546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:00:36.911546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:00:36.914681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-8c0d35f7-61e7-4d93-99cb-f8a7917ac190 req-7ac18bc7-62c0-4524-8bb6-adf7af9348da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033866 Sep 26 18:00:36.915277 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 226/460] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:36.918412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.918914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.919355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.920100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:36.920538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:36.920966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:36.938049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Getting quotas for project df8e59bd01c64c8f8d7302ff01bba771. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:00:36.941996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Getting quotas for user 0f74dd694d7f4f999130294e1f8828d7 and project df8e59bd01c64c8f8d7302ff01bba771. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:00:36.953524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:00:36.955750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a3ac027-ab88-45df-893f-73c3e4187c0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:00:37.093952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-da3027b4-7f63-4240-a301-629c71bba83c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757088 Sep 26 18:00:37.094735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 235/461] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:00:37.106029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3a618746-d439-4ba1-ab18-46afb213880e tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:37.106809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3a618746-d439-4ba1-ab18-46afb213880e tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:37.171493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3a618746-d439-4ba1-ab18-46afb213880e tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:37.179778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3a618746-d439-4ba1-ab18-46afb213880e tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1258 microversion: 2.1 time: 0.077901 Sep 26 18:00:37.180349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 227/462] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:37 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:37.660357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:37.660970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:37.667866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:37.668212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:37.668726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:37.669355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:37.669892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:37.670287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:37.806675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:37.814551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-76a977af-6e99-4423-97ae-8d260afc1123 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.158507 Sep 26 18:00:37.815318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 236/463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:37 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:37.906311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:37.907106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:37.913971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:37.914602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:37.915048 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:37.915748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:37.916201 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:37.916628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:38.046262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:38.055405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:38.056847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:38.058261 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-40e07d49-92a1-4b26-b9ad-900ab4b8336c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1721 microversion: 2.20 time: 0.156340 Sep 26 18:00:38.058982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 228/464] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:37 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:38.203630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5be407a5-2d7b-4516-9e0d-93c9b0a5fa32 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:38.203984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5be407a5-2d7b-4516-9e0d-93c9b0a5fa32 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:38.260737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5be407a5-2d7b-4516-9e0d-93c9b0a5fa32 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:38.267723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5be407a5-2d7b-4516-9e0d-93c9b0a5fa32 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1258 microversion: 2.1 time: 0.068254 Sep 26 18:00:38.268292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 237/465] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:38 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:38.837737 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:38.838372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:38.844401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:38.844888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:38.845359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:38.846110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:38.846569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:38.847254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:38.973756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:38.982321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e89be638-0868-4a59-b583-aab08b5083e5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.148865 Sep 26 18:00:38.982904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 229/466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:38 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:39.083467 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:39.084083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:39.091045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:39.091676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:39.092118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:39.092817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:39.093297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:39.093725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:39.248919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:39.257896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:39.260520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:39.261931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6add9f84-ca9f-49c7-8c48-59511b5ebb8a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1721 microversion: 2.20 time: 0.182497 Sep 26 18:00:39.273913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 238/467] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:39 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:39.292771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:39.293520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:39.304009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:39.309136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:39.309810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:39.310740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:39.311303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:39.312264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:39.378699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:39.386979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2f86315d-400f-4ae6-8b05-750a0ccd2421 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1254 microversion: 2.1 time: 0.099441 Sep 26 18:00:39.387539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 230/468] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:39 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1254 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:40.005687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:40.006448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:40.012456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.012961 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.013422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.014223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.014727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.015152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.145506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:40.154812 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7bd04591-b320-4413-b66c-579e85a219fd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.153690 Sep 26 18:00:40.155390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 239/469] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:39 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:40.302085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:40.303079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:40.308911 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.309431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.309856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.310732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.311184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.311607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.411701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:40.412781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:40.426263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.427533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.428444 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.429880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.430684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.431292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.546745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:40.554163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:40.555954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-25411fd4-9a52-4cc4-baf2-787b93a63bb4 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1318 microversion: 2.1 time: 0.150220 Sep 26 18:00:40.556528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 240/470] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:40 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:40.562981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:40.571404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:40.571404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1087b8ab-03b7-4ac1-8d0d-05d14605af4a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1724 microversion: 2.20 time: 0.267993 Sep 26 18:00:40.571404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 231/471] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:40 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:40.595803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d9a4625-b622-41f8-9bc9-2d4bb62bcff8"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:40.598960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:40.604992 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.605525 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.605959 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.606669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.607125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.607557 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.785876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9a9e8a-7083-4630-b3a3-f06226a6b58f", "name": "network-vif-plugged", "status": "completed", "tag": "16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:40.795907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:40.796387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:40.796814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:40.809402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] Creating event network-vif-plugged:16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786 for instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f on hv-cinder-85931 Sep 26 18:00:40.814735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-738fb707-8789-47ef-bd2d-b2412ceb5d47 req-9b3d1a94-1deb-4d3b-848d-ce1e91114acb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Sep 26 18:00:40.821309 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 232/472] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:41.182022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:41.182805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:41.189091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:41.189682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:41.190194 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:41.190961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:41.191490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:41.192023 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:41.381889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:41.402063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dc181b20-1ad8-48d4-ab94-190abf97aae6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.222343 Sep 26 18:00:41.403740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 233/473] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:41 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:41.578870 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:41.579502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:41.585540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:41.586100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:41.586610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:41.587414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:41.587922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:41.588417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:41.723520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:41.732781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-affefa5f-4661-4e2b-8efd-940a40274f0b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.158056 Sep 26 18:00:41.733606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 234/474] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:41 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:41.841357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5fda6ea2-cb5f-4f0b-92ec-aed73a4d7dc7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.250768 Sep 26 18:00:41.842769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 241/475] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 18:00:40 2022] POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments => generated 188 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:00:42.014740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:42.015340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:42.027056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.028494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.029336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.031227 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.032215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.033082 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.086953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132948) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:00:42.367507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:42.380082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.380589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.381052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.394564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] Creating event network-changed:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:00:42.401347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-80a6b336-6129-4b17-bde3-352a496129ca req-7826caac-5d6c-41d6-af25-6bf48a8c1d34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038152 Sep 26 18:00:42.402175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 242/476] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:00:42.426320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:42.427756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:42.435066 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.435921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.438491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.438491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.438491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.438957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.480728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bd11534f-14de-4884-b342-80e2cfd089a9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/action" status: 202 len: 0 microversion: 2.20 time: 0.471038 Sep 26 18:00:42.483978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 235/477] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 18:00:42 2022] POST /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:00:42.493076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:42.495217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:42.509076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.512716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.513190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.518662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.518662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.518662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.648799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:42.659062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ded9839f-dfa5-43e1-9b66-06ea858bf139 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.237214 Sep 26 18:00:42.660012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 243/478] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:42 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:42.706809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:42.719858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:42.719858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:42.720235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-96b845d3-e7ab-4a72-a9a4-67fb683e0b5f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.231765 Sep 26 18:00:42.720793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 236/479] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:42 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:42.759793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:42.760412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:42.773103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.784031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.784497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:42.785269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:42.789189 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:42.809911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:43.007052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:43.014956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cf812bdc-f21d-48c5-a335-c0f05986c789 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.259965 Sep 26 18:00:43.033551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 244/480] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:42 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:43.685977 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:43.686864 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:43.693741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:43.694222 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:43.694691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:43.695430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:43.696084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:43.696643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:43.747759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:43.748682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:43.755111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:43.755908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:43.757187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:43.758057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:43.758654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:43.759222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:43.932418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:43.941129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:43.941659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cad57bc2-e71e-4960-9ac8-b7c69749c2c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.259851 Sep 26 18:00:43.942263 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 237/481] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:43 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:43.978084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:43.981332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:43.982886 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1cd2c080-0095-4f23-88ae-79e9b23f0e38 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.239120 Sep 26 18:00:43.987198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 245/482] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:43 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:44.043076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:44.043793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:44.050469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:44.051031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:44.051694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:44.052459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:44.052974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:44.053497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:44.200802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:44.208900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e5dd2527-c481-4b9e-956b-364c2f7a0f94 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.170391 Sep 26 18:00:44.209585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 238/483] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:44 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:44.964526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:44.965281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:44.972067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:44.972678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:44.973245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:44.974078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:44.974671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:44.975195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:45.010963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:45.011563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:45.018351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:45.019097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:45.019534 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:45.020411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:45.021046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:45.021661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:45.182214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:45.192064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c54fee9e-288b-4917-ac79-d7effcaac54b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.231750 Sep 26 18:00:45.193133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 246/484] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:44 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:45.217345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:45.226328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:45.227821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:45.229002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-baa2228d-2c9c-4b4a-8189-b15ba7aba552 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.222759 Sep 26 18:00:45.229635 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 239/485] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:45 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:45.292090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:45.292701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:45.299200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:45.299688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:45.300124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:45.300936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:45.301425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:45.301853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:45.439420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:45.443318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:45.457382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-01078e86-677b-4919-b75b-2e1a4948d5f6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.164268 Sep 26 18:00:45.457382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 247/486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:45 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:46.216454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:46.217078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:46.220803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:46.224247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.224732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.225242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.226524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.226979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.227408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.257082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:46.260197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:46.271447 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.272236 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.273173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.274072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.274545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.274952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.435990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:46.451982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8ab9d8df-07b6-495f-b25c-8036c54072c3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.239275 Sep 26 18:00:46.467196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 240/487] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:46 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:46.479338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:46.481867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:46.482445 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:46.490268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.490794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.491239 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.491485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:46.492001 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:46.492494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:46.492919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:46.493938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:46.495220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fdeea58a-35c8-481a-b13f-81db5d9fd530 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.243697 Sep 26 18:00:46.496043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 248/488] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:46 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:46.648954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:46.657165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8cb86a8a-5edb-4337-857b-9b91921a9b1b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.180581 Sep 26 18:00:46.657759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 241/489] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:46 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:47.478760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:47.479423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:47.481321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:47.487551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.488304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.488936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.489877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.490359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.490793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.521414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:47.522030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:47.524402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=6 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:47.529850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.530335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.530777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.531470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.531922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.532353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.703728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:47.712305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f68fc1f6-f54f-428d-a818-fb8398337022 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.238224 Sep 26 18:00:47.712879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 249/490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:47 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:47.728466 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:47.728821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:47.728821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:47.734872 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:47.735042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.735873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.736281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:47.736425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.737469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-aec1f653-9701-4468-9d8d-567e825cf6c8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.220270 Sep 26 18:00:47.737615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:47.738022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 242/491] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:47 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:47.741337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:47.741906 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:47.951175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:47.959166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-727e4ada-55ee-45f0-984c-4c3172533971 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.240813 Sep 26 18:00:47.959750 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 250/492] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:47 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:48.736119 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:48.736850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:48.746558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:48.747097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:48.747542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:48.748208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:48.748706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:48.749121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:48.770792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:48.774181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:48.778912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=8 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:48.781482 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:48.782210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:48.782859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:48.783783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:48.784449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:48.785088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:49.001732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:49.004530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:49.013079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-56032532-b0f5-4db5-8ec8-f90a2c34958e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.280879 Sep 26 18:00:49.018929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:49.020461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:49.021700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fa4fa652-7e6b-4392-a4a5-1ea703eb37f2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.256346 Sep 26 18:00:49.022257 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 251/493] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:48 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:49.025596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 243/494] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:48 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:49.029735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:49.030557 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:49.037269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:49.037269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:49.038122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:49.038926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:49.040235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:49.040676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:49.198821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:49.207730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-879df2c5-38ce-424c-b393-449acad996d3 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.183972 Sep 26 18:00:49.208426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 252/495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:49 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:50.039858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:50.040478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:50.048127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:50.048748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.049149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.049607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.050191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:50.050311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.050752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.051155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.055888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:50.061370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.062219 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.062662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.063376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.063829 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.064281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.273456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:50.277254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:50.284520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-42fe979b-1398-40f2-9f12-cf1443ad8f9c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.250885 Sep 26 18:00:50.285438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 244/496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:50 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:50.290305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:50.291296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:50.295916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:50.297633 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:50.298670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.299031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0ee79d69-8707-497d-95aa-f54d8641b9b9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.254970 Sep 26 18:00:50.299499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.300154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 253/497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:50 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:50.300345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.301434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:50.302081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:50.302659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:50.455683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:50.464243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cf49b9e7-de04-4134-8730-3848d609e35c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.177606 Sep 26 18:00:50.464815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 245/498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:50 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:51.317583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:51.319120 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:51.335697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.335816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:51.336293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.336397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:51.336498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.336498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.336498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.336498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.336845 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.336933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.337404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.338105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.338748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.339515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.555292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:51.559472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:51.563110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3ce0a053-5f34-4498-a8bc-71aaf8196447 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.249684 Sep 26 18:00:51.563680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 254/499] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:51 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:51.568023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:51.568631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:51.574771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.575255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.575694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.576380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:51.576833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:51.577279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:51.583558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:51.589833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:51.589833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-77e3b5a8-ec03-41f6-9d6d-39e57624a587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.263611 Sep 26 18:00:51.589833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 246/500] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:51 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:51.715270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:51.722781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-97c73a9a-8f89-42c5-84a3-49e2d146ce42 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.158116 Sep 26 18:00:51.723351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 255/501] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:51 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:52.591251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:52.591810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:52.598238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.598749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.599178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.599852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.600334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.600747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.613765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:52.614376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:52.620987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.621671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.622123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.622825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.623281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.623815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.799495 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:52.805079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:52.808898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a6ca9909-054a-4db6-bfa9-5f503daec6fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.221504 Sep 26 18:00:52.809786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 247/502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:52 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:52.818353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:52.818969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:52.821316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:52.822806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:52.823963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dde7c139-2b05-4a12-ac75-0fd8966bd15d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.214354 Sep 26 18:00:52.837249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 256/503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:52 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:52.837477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.837477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.837477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.837477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:52.837839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:52.837839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:52.971302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:52.978992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6ec8c9b9-4f0c-42ae-a85d-87859c3d74fd tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.164714 Sep 26 18:00:52.979551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 248/504] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:52 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:53.832009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:53.832777 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:53.839784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:53.840374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:53.840901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:53.841692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:53.842289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:53.842798 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:53.852138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:53.853161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:53.861561 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:53.862090 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:53.863210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:53.864046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:53.864565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:53.864999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:54.044481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:54.048601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:54.052305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f4ff4218-2486-4041-8516-39e970e54db4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.224004 Sep 26 18:00:54.052873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 257/505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:53 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:54.057368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:54.058000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:54.058630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:54.059706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:54.060284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:54.061740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2456d2ab-c971-43fb-8b18-5459aaf54b5a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.214748 Sep 26 18:00:54.068902 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 249/506] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:53 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:54.069034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:54.069034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:54.069034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:54.069034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:54.069899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:54.069899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:54.201141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:54.208924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f427e86a-9ff1-47b2-aee3-c56d1e5b3791 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.155075 Sep 26 18:00:54.224841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 258/507] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:54 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:55.075596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:55.076358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:55.082981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.083640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.084159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.085510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.086044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.086557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.090347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:55.091108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:55.097999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.098487 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.098920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.099816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.100271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.101312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.299252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:55.303561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:55.307127 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eda4561b-0165-4dd4-b139-06217ad1ea55 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.235659 Sep 26 18:00:55.307700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 250/508] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:55 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:55.312158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:55.312512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:55.313133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:55.314064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:55.315231 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7fc78d9f-4ec1-492d-aeb1-ab5fd2615e05 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1750 microversion: 2.20 time: 0.228965 Sep 26 18:00:55.315778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 259/509] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:55 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:55.328814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.331903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.331903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.331903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:55.331903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:55.332248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:55.472724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:55.486530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c0ce8a95-c159-4571-a590-23dea63e746b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.177334 Sep 26 18:00:55.499208 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 251/510] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:55 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:56.331262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:56.332071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:56.345438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.345616 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:56.346074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:56.346243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.347148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.348225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.349719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.350374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.352288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.352991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.353611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.354469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.355084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.355654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.554457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:56.567637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:56.569880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:56.572072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-69b1cc12-c38f-4e0b-89ff-ce8637aa3027 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1752 microversion: 2.20 time: 0.230726 Sep 26 18:00:56.572852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 252/511] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:56 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:00:56.578699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:56.579792 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:56.591101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.591868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.599238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.599238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:56.599238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:56.599238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:56.604986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:56.617327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-807fbbf0-c5b4-4cf7-828e-40f5ec6cbb98 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1367 microversion: 2.1 time: 0.288619 Sep 26 18:00:56.630056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 260/512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:56 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:56.756645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:56.765478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2512aa11-347b-457a-9fe8-243def91c1f9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.191037 Sep 26 18:00:56.766138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 253/513] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:56 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:57.600111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:57.606822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:57.607318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.607801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.608236 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.608925 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.609408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.609857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.642140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:57.643196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:57.652595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.653104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.653569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.654273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.654800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.655240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.787296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:57.798497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:57.799952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:57.801112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ffd94eb7-50bc-4a4a-a444-a1732048c12d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1752 microversion: 2.20 time: 0.205252 Sep 26 18:00:57.801692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 261/514] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:57 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:57.806535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:57.807189 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:57.813282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.813906 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.814538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.815449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.815918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.816370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.821284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:57.829704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-76ddd1a9-7705-4d6f-bf48-cfa57ad1aff8 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1557 microversion: 2.1 time: 0.191342 Sep 26 18:00:57.830685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 254/515] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:57 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:00:57.853388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:57.853917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:57.860229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.860749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.861191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.861916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:57.862376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:57.862799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:57.964748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-64f6ed9e-75ae-4142-ae39-ab4e6c437296 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116205 Sep 26 18:00:57.965359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 255/516] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:00:57 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:00:57.982413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:57.990265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ec3864f5-3a88-44af-84f3-c9d90e1a2386 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.187617 Sep 26 18:00:57.990856 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 262/517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:57 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:58.551088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1705153455", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "networks": [{"uuid": "916bf790-1a83-44fc-a77a-94ae8e7ef414"}]}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:58.610518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] validate_networks() for [('916bf790-1a83-44fc-a77a-94ae8e7ef414', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:00:58.828698 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:58.829478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:58.836309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:58.836878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:58.837484 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:58.838374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:58.838831 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:58.839263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.294008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:59.302772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:59.304923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:59.306117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4cac04c7-0550-4af5-8866-d5bf60e5e4ee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1752 microversion: 2.20 time: 0.481550 Sep 26 18:00:59.306877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 263/518] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:00:58 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1752 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:00:59.318796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:00:59.318796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:00:59.318796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:00:59.318796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:00:59.318796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:00:59.327098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:59.327817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:59.328630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.329914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:59.330145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9a9e8a-7083-4630-b3a3-f06226a6b58f", "tag": "16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:00:59.331043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:59.332722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.339976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:59.341054 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:59.341054 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.354888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Getting quotas for project 7407b259f9ce40558c02a60e29e50c93. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:00:59.360722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Getting quotas for user 6220cf71845241c2ad61cf77e2ea9fe9 and project 7407b259f9ce40558c02a60e29e50c93. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:00:59.361005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] Creating event network-changed:16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786 for instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f on hv-cinder-85931 Sep 26 18:00:59.369381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-6d8324df-c59b-4828-bcf6-53dcb296943b req-530d667f-fb63-4b79-babe-866c36d75b44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042712 Sep 26 18:00:59.373384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 264/519] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:00:59.380704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:59.381448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:59.384693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:00:59.387683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:00:59.389508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:59.390188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:59.391002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.392199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:00:59.393558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:00:59.394156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:00:59.413195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:59.564981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3d7adbf1-af8b-4a74-a077-780b861b8d44 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017782 Sep 26 18:00:59.567218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:59.572571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 256/520] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:00:59.576983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d9b9db12-8ebb-4bac-a2ee-fda8883517d5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.201776 Sep 26 18:00:59.577606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 265/521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:59 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:00:59.578587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8b7fe47f-d122-4cd1-9ed2-43f9ada8727c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:00:59.579211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8b7fe47f-d122-4cd1-9ed2-43f9ada8727c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:00:59.655702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8b7fe47f-d122-4cd1-9ed2-43f9ada8727c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:00:59.665801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8b7fe47f-d122-4cd1-9ed2-43f9ada8727c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1219 microversion: 2.1 time: 0.088304 Sep 26 18:00:59.678327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 257/522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:00:59 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:00.332048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:00.332788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:00.355192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:00.355616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:00.356028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:00.356737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:00.357269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:00.362543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:00.551492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:00.561286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:00.562767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:00.563998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-96a29aaf-b0ad-4e27-bdc0-44c986f1d6a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.235958 Sep 26 18:01:00.564554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 266/523] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:00 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:00.599999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:00.601701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:00.608533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:00.611671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:00.611671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:00.611671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:00.611671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:00.611986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:00.687935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cde1317c-5d14-48e6-b659-87fed94f6b8c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:00.688564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cde1317c-5d14-48e6-b659-87fed94f6b8c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:00.805281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cde1317c-5d14-48e6-b659-87fed94f6b8c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:00.814905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cde1317c-5d14-48e6-b659-87fed94f6b8c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1219 microversion: 2.1 time: 0.131948 Sep 26 18:01:00.816107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 267/524] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:00 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:00.833739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:00.844210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7c5461d6-de7d-4def-b305-003ec08eecec tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.248052 Sep 26 18:01:00.869401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 258/525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:00 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:01.590851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:01.591451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:01.598877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.599370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.600009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.600720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.601180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.601682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.746946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:01.758184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:01.759664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:01.760840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b7743acb-67ff-4dce-8081-d60b33c8b0d4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.174177 Sep 26 18:01:01.761695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 268/526] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:01 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:01.850142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:01.852211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:01.861615 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.862250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.863017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.863808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.864442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.864936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.889052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:01.890424 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:01.900740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.904899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.904899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.904899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:01.904899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:01.905320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:01.966943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:01.980358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-293483ea-8b69-448b-b978-a7982bcb6c5f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.136265 Sep 26 18:01:01.999367 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 259/527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:01 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:02.107482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "name": "network-vif-plugged", "status": "completed", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:02.121505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:02.121742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:02.124442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:02.130603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0705e4d9-5eda-4f7a-82d4-5877355003d9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.246325 Sep 26 18:01:02.132682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 269/528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:01 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:02.139047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:02.172549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] Creating event network-vif-plugged:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:01:02.178050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-fc37d5e2-90d7-4810-9abc-d1269c01f10e req-0af6e288-7328-4c08-a014-962583e41753 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074116 Sep 26 18:01:02.178689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 260/529] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:02.788824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:02.790200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:02.798332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:02.798817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:02.799256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:02.800381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:02.800834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:02.801277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:02.945769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:02.955129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:02.956651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:02.958015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8e649fe5-7535-4253-9440-ab93094b9424 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.173760 Sep 26 18:01:02.958760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 270/530] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:02 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:03.009061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:03.009799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:03.016665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.017151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.017706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:03.018451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.018911 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.019335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:03.114037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:03.122198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3a881899-c4a4-42cb-acd4-abb02688d298 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.117946 Sep 26 18:01:03.122784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 261/531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:03 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:03.164564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:03.165200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:03.175645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.176284 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.176733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:03.177482 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.178432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.178961 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:03.332528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:03.340558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-976dafab-0777-459c-a576-7420c7974bf9 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.180041 Sep 26 18:01:03.354268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 271/532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:03 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:03.984295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:03.984910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:03.991676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.996395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.996395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:03.996395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:03.996395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:03.996786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:04.146948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:04.148846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:04.158338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:04.158825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:04.159262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:04.161378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:04.162068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:04.162733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:04.177454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:04.193810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:04.196126 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:04.198684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1c7950dd-ee7a-4a20-b7c8-e28809aa6480 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.218457 Sep 26 18:01:04.205788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 262/533] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:03 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:04.229134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:04.237329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-92a77e77-8c04-4913-9a08-f82ad62107e3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.094587 Sep 26 18:01:04.237908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 272/534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:04 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:04.364007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:04.364894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:04.371279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:04.371767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:04.372202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:04.372888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:04.373367 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:04.373786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:04.388202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:04.516755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:04.525165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-438d48f9-9f30-4c46-bc9d-9404e59e3914 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.165071 Sep 26 18:01:04.525769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 263/535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:04 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:05.224041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:05.224626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:05.231663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.232134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.232604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.233312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.234066 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.234502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.261005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:05.261813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:05.268421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.268904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.269552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.270551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.271081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.271562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.365301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:05.373125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-62020425-0b17-4515-b96b-5f8a8e80119c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.116638 Sep 26 18:01:05.373932 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 264/536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:05 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:05.407598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:05.416995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:05.418784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:05.420118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1bc7a3fe-fe72-4aec-b3c9-cdc900eaf5fe tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.200120 Sep 26 18:01:05.420669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 273/537] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:05 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:05.549748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:05.550350 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:05.556266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.556742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.557171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.557918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.558372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.558791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.691526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:05.699867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-12ee8a5e-1149-491d-9e52-c3065b5d1738 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.154032 Sep 26 18:01:05.700423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 265/538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:05 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:06.396104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:06.396731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:06.403569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.404053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.404486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.405182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.405656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.406086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.445514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:06.446282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:06.453101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.453674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.454112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.455050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.455795 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.455969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.470666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:06.480923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5645b0f6-acd7-4a76-aa33-a5d012c5e828 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.088616 Sep 26 18:01:06.493309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 274/539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:06 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:06.601499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:06.611131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:06.612583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:06.613784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0681b4ee-0861-428f-8b6c-613679eedfe6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.172343 Sep 26 18:01:06.614338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 266/540] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:06 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:06.723623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:06.724402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:06.730697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.731271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.731773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.735796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:06.735796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:06.735796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:06.876142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:06.883887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-74fc1eef-ed2f-4bf6-a70c-899a9e3a5d50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.164169 Sep 26 18:01:06.884452 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 275/541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:06 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:07.505091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:07.505739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:07.513174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.513694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.514135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.514840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.515297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.515725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.581800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:07.589504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ec7ec84a-c593-4a99-a311-8306a36d9f06 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.088324 Sep 26 18:01:07.590065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 267/542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:07 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:07.640049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:07.640680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:07.647349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.647842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.648290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.649062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.649594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.650034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.787264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:07.796932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:07.798445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:07.799609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d285ac0d-a726-494f-8fe3-e572e28922d1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.163594 Sep 26 18:01:07.800165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 276/543] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:07 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:07.908177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:07.908789 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:07.915545 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.916041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.916481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.917179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.917667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.918098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.054159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:08.071833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7aa92698-5a48-495c-bb85-f2c48d7b39a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.167442 Sep 26 18:01:08.077345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 268/544] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:07 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:08.613478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:08.614125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:08.620944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.621504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.621907 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.622619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.623079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.623512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.652725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a5fc7c7-ff41-46cf-94a3-aba081618168"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:08.656022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:08.666880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.667371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.667956 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.668777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.669301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.669918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.691950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:08.700755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5e0f5033-ced5-43d0-a3c0-98242850b5ff tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.091233 Sep 26 18:01:08.701785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 277/545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:08 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:08.826455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:08.827068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:08.833190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.833711 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.834150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.835378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:08.835846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:08.836273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:08.971429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:08.981586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:08.983138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:08.984432 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-46c19054-d1ad-4e67-af65-dd5ce5cc8cb1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.162349 Sep 26 18:01:08.985279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 278/546] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:08 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:09.096316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:09.096937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:09.103924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:09.104455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:09.104915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:09.105674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:09.106132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:09.106563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:09.242519 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:09.250474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b0234ae8-c72f-4603-b193-4124801e987f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.158010 Sep 26 18:01:09.251256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 279/547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:09 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:09.344616 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:09.663640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=8 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:09.736114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:09.736887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:09.743861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:09.744336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:09.744799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:09.745486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:09.745931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:09.746349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:09.809056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:09.823598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1545316d-b45d-429e-9da2-3bcd73ab4fe9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.091353 Sep 26 18:01:09.824562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 280/548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:09 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:10.009901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:10.010546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:10.016696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.017187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.017654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.018367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.018822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.019255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.156678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:10.166104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:10.167653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:10.168882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7a26668e-5302-4a5f-966c-04cdfca9a239 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.162879 Sep 26 18:01:10.169538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 281/549] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:10 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:10.274663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:10.275601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:10.283772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.284461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.284994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.285913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.286420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.286857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.424190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:10.427795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:10.433123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-70d0c985-207c-434c-aa4a-ac95b037fdaf tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.163542 Sep 26 18:01:10.433744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 282/550] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:10 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:10.846861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:10.847567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:10.851705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:10.858144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.858640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.859081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.860133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:10.860652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:10.861089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:10.936709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:10.944895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4345000b-0de5-4d79-8a3e-32e907ea9719 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.102380 Sep 26 18:01:10.945576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 283/551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:10 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:11.198137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:11.198752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:11.204954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.205480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.205921 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:11.206616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.207075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.207507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:11.357177 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:11.366602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:11.375485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:11.375485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a68c4186-6f87-46e3-92ac-af89c1ad6698 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.175290 Sep 26 18:01:11.375485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 284/552] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:11 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:11.457508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:11.458041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:11.464659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.465152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.465620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:11.466413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.466871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.467300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:11.607046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:11.614765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a3333c80-1f71-4ebe-80ac-034c7fca1620 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.161436 Sep 26 18:01:11.615538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 285/553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:11 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:11.973463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:11.974822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:11.984380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.984871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.985345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:11.986053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:11.986510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:11.986940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:12.056201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:12.064261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e2f5c0b8-edf9-4b20-b9e9-e1d17fa8b9c7 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.098638 Sep 26 18:01:12.065035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 286/554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:11 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:12.394611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:12.395238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:12.402560 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:12.403048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:12.403485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:12.404175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:12.404630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:12.405058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:12.548103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:12.557112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:12.558823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:12.559997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b6a44a35-b891-40e0-bc74-8fd86c544c97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.169297 Sep 26 18:01:12.560880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 287/555] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:12 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:12.637639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:12.638244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:12.644197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:12.644675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:12.645108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:12.645815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:12.646266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:12.646685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:12.776781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:12.784558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-35fa9bf3-9550-4281-b188-ba653c741956 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.150782 Sep 26 18:01:12.785110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 288/556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:12 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:13.089503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:13.090456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:13.097183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.097703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.098138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.098839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.099291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.099716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.162973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:13.170584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-25dbd82c-020e-4dcb-840b-0956abf2a306 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.086416 Sep 26 18:01:13.171145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 289/557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:13 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:13.586335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:13.586950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:13.592915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.593436 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.593877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.594565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.595019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.595480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.725196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:13.734767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:13.740756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:13.740756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3e4d73f0-73a8-4ce5-80fd-fa0ce6009d80 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.154931 Sep 26 18:01:13.740756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 290/558] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:13 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:13.807709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:13.808330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:13.814483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.814973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.815413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.816102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:13.816585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:13.817013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:13.963709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:13.971376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2e4dc9db-fee6-4a7d-81d9-15cd55d4101a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.168332 Sep 26 18:01:13.971933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 291/559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:13 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:14.193253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:14.193958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:14.200493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:14.200966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:14.201441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:14.202116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:14.202561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:14.202983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:14.268753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:14.276884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a1248ea7-5bf3-4978-9912-baf91973726d tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.087523 Sep 26 18:01:14.277718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 292/560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:14 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:14.762905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:14.763769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:14.770140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:14.770720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:14.771228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:14.772002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:14.773335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:14.773770 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:14.909679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:14.918367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:14.919766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:14.920922 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5f16cf1f-9d92-4e02-a655-4d7487c37dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.162306 Sep 26 18:01:14.921520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 293/561] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:14 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:14.994713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:14.995329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:15.001178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.001703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.002143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:15.002869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.003323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.003749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:15.133401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:15.142585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6840a5b6-ba34-486d-a58a-52d4658f1f54 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.152015 Sep 26 18:01:15.146476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 294/562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:14 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:15.165916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c759c746-f330-4e6e-acda-4f3041a6cba4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.517433 Sep 26 18:01:15.167372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 269/563] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:01:08 2022] POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 194 bytes in 6519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:15.300434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:15.301395 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:15.308455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.308941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.309416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:15.310119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.310815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.311320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:15.376226 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:15.384097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4a3c1b19-ffc9-415d-ab71-7bf082c5dbbe tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1271 microversion: 2.1 time: 0.087673 Sep 26 18:01:15.384678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 295/564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:15 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:15.947483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:15.948188 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:15.954471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.954957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.955398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:15.956083 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:15.956543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:15.956974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:16.085984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:16.094884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:16.096330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:16.097520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6a3952de-4831-46da-8a3d-403195a86ac8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.154973 Sep 26 18:01:16.098107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 270/565] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:15 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:16.165598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:16.166218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:16.172590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:16.173718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:16.174325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:16.175218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:16.175683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:16.176180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:16.336389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:16.344469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-08801906-fed8-46a4-839f-c47419b0d9e0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1358 microversion: 2.1 time: 0.182686 Sep 26 18:01:16.345062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 296/566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:16 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:16.407746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:16.408364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:16.414707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:16.415215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:16.415637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:16.416521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:16.417139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:16.417594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:16.502129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:16.510530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a5ea9dd8-14c1-45aa-8d4b-62c902760bbd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1289 microversion: 2.1 time: 0.106740 Sep 26 18:01:16.511094 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 271/567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:16 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:17.123227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:17.124014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:17.130093 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.130584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.131022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.131722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.132175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.132605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.267084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.276371 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.278336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.279581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6071544d-1f69-448e-852b-124c055eee57 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.160640 Sep 26 18:01:17.280254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 297/568] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:17 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:17.367722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:17.368331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:17.370276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:17.375019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.375500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.375932 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.376618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.377069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.377526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.522894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.531028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-63b02284-ed66-4fd9-acea-f90ab266c008 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1548 microversion: 2.1 time: 0.167643 Sep 26 18:01:17.531588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 272/569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:17 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:17.535972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:17.536591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:17.543658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.544144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.544611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.545373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.545835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.546286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.558504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:17.559109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:17.565023 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.565531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.565953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.566812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.567262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.567684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.755608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.758949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.763380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-14cbc7f6-33fc-467f-b451-0f7c86d45fc0 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.231252 Sep 26 18:01:17.763951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 298/570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:17 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:17.767706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d63ec9cb-909a-4336-8562-02150ec6a550 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1548 microversion: 2.1 time: 0.213540 Sep 26 18:01:17.768380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 273/571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:17 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:17.800044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:17.805595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:17.806359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Searching by: {'deleted': False, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771'} {{(pid=132949) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 18:01:17.812948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.813479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.813912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.814622 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:17.815076 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:17.815490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:17.905725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.multi_cell_list [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132949) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 18:01:17.931209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:17.998341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-086afce2-e0f6-4ac7-bc79-b1ae66cc643a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202109 Sep 26 18:01:17.998919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 299/572] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Sep 26 18:01:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:18.010911 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:18.011527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:18.017840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.018407 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.018882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.019583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.020033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.020463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.154083 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:18.162008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-be0bd081-74ec-4269-b4d2-646ff36e139c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1548 microversion: 2.1 time: 0.155284 Sep 26 18:01:18.162672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 274/573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:18 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:18.292830 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0845f91-ab86-4e38-86cc-14451ecc1392", "tag": "eb392aee-4e73-4b08-bf94-37264b5f28aa"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:18.307288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:18.308346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:18.315477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.315811 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.316307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.316729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.321638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.322086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.322799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.323252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.323679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.334545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] Creating event network-changed:eb392aee-4e73-4b08-bf94-37264b5f28aa for instance d0845f91-ab86-4e38-86cc-14451ecc1392 on hv-cinder-85931 Sep 26 18:01:18.339833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-a750bd9c-6aaf-41d0-a248-3e72a651266f req-bbb8bad7-7243-4123-ba0f-a9db6285a298 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051101 Sep 26 18:01:18.340746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 300/574] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:18.476519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:18.485350 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:18.487007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:18.488155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-67705761-d023-41d8-abb2-5575686d565a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.184896 Sep 26 18:01:18.488704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 275/575] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:18 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:18.789520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:18.790242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:18.796662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.802202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.802202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.802202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:18.802202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:18.802603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:18.948049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:18.956145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-387c94b9-f274-4f6c-8bb8-079e571e0dac tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.171807 Sep 26 18:01:18.957303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 301/576] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:18 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:19.513314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:19.513920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:19.520289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.520760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.521182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:19.521879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.522324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.522744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:19.651933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:19.660993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:19.662485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:19.663646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c206b86e-d495-40e9-bd31-f8b56529f041 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.154223 Sep 26 18:01:19.664204 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 276/577] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:19 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:19.980312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:19.980984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:19.987462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.987943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.988380 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:19.989078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.989560 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.989986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.123754 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:20.131273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d7c1651a-3518-4501-9fbc-2fa5988e4f10 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.155360 Sep 26 18:01:20.131844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 302/578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:19 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:20.155255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16df46df-19d4-4ecc-bd73-49a39a8739da"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:20.157703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:20.164614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.165357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.165797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.166491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.166939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.167358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.688966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:20.689606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:20.696061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.696542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.696977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.697695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.698150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.698574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.831127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:20.840446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:20.841974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:20.847891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-daa29107-9df1-492c-bff2-3176deed549d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.158057 Sep 26 18:01:20.847891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 303/579] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:20 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:21.154515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:21.155194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:21.161485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:21.161952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:21.162388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:21.163073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:21.163523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:21.163946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:21.290118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:21.297561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-395c319c-10d3-4c57-85b2-ac212405b486 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.147174 Sep 26 18:01:21.298121 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 304/580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:21 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:21.872182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:21.872779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:21.878704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:21.879175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:21.879608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:21.880286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:21.880729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:21.881142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:22.012282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:22.021067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:22.022545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:22.023703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5869e9cf-669d-4f69-9cdd-71a71bc7654e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.155434 Sep 26 18:01:22.024258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 305/581] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:21 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:22.320486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:22.321643 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:22.327918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:22.328404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:22.328848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:22.329582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:22.330055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:22.330507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:22.461239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:22.469357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9258a2da-4737-438b-9f10-dd92a6253be3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.153034 Sep 26 18:01:22.469958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 306/582] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:22 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:22.486679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:22.653271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c782f23f-f0be-4f58-9e3a-9260e0d88155 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.501438 Sep 26 18:01:22.654432 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 277/583] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:01:20 2022] POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments => generated 194 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:23.049768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:23.050370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:23.052346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:23.057012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:23.057521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:23.057955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:23.058632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:23.059078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:23.059494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:23.190800 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:23.199887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:23.201357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:23.202506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d8b3c255-01d9-41f9-af73-039d8b61ae97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.156623 Sep 26 18:01:23.203071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 307/584] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:23 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:23.496061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:23.498188 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:23.503684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:23.504167 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:23.504611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:23.505346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:23.505826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:23.506271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:23.644596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:23.652894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7756d0bb-2983-4d58-accd-b67b70681f0c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.162905 Sep 26 18:01:23.653528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 278/585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:23 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:24.118580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0845f91-ab86-4e38-86cc-14451ecc1392", "name": "network-vif-plugged", "status": "completed", "tag": "eb392aee-4e73-4b08-bf94-37264b5f28aa"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:24.131417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.132015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.133204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.147108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] Creating event network-vif-plugged:eb392aee-4e73-4b08-bf94-37264b5f28aa for instance d0845f91-ab86-4e38-86cc-14451ecc1392 on hv-cinder-85931 Sep 26 18:01:24.152589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-3a38a192-3de8-4b7e-8fcb-a347af60f0ac req-932e2c65-f048-4b56-a73f-9309ed428dfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038120 Sep 26 18:01:24.153252 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 308/586] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:24.227774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:24.228385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:24.234439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.234926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.235363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.236062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.236515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.236940 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.369333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:24.377839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:24.379254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:24.380537 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bba8e37a-812a-4b0f-a83e-c046befaadfb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.157224 Sep 26 18:01:24.381104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 279/587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:24 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:24.676645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:24.677385 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:24.684281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.684767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.685205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.685928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.686469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.686897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.828211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:24.836672 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2d9bef63-7fbb-47fb-83e1-6fd40327774f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.164303 Sep 26 18:01:24.837339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 309/588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:24 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:24.874282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:24.876579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:24.882933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.883416 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.883849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.884532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:24.884978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:24.885422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:24.908698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'flavor' on Instance uuid 26523d3d-340f-4fcc-8594-b8033312e8b2 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:01:25.388024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-19030ff9-054a-4340-8f44-ba34eaa7e7f9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/action" status: 200 len: 32 microversion: 2.1 time: 0.517567 Sep 26 18:01:25.388624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 280/589] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:01:24 2022] POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/action => generated 32 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:01:25.398644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:25.399227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:25.406221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.409792 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:25.409914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.410039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:25.410142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.410142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.410142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.410142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.413127 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.413649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.414077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.414759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.415224 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.415626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.601664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:25.605175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:25.610312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c3f18710-41d1-4879-9bee-2a9e1ef8b41f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.215881 Sep 26 18:01:25.611191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 310/590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:25 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:25.613927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:25.615404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:25.616589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cb5fb612-81f1-4d60-8ef7-5417240ecbcf tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.214589 Sep 26 18:01:25.617847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 281/591] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:25 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:25.860189 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:25.860876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:25.867762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.868253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.868720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.869554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:25.869897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:25.870324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:25.997604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:26.005281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b0946634-8b1a-43f7-aeb8-3e7a418d1cc8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1319 microversion: 2.1 time: 0.148899 Sep 26 18:01:26.005853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 311/592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:25 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:26.634816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:26.635429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:26.642196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:26.642692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:26.643060 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:26.643531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:26.643660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:26.643833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:26.644282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:26.644749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:26.650491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:26.656393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:26.656393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:26.656393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:26.656393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:26.656775 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:26.841128 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:26.844827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:26.855297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0f38e086-cf77-44c5-bde3-c45bdd2ee243 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.224861 Sep 26 18:01:26.855843 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:26.855981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 282/593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:26 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:26.857328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:26.858535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-557c451f-7514-4894-8592-a96557c9bb41 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.219220 Sep 26 18:01:26.859736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 312/594] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:26 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:27.028597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:27.029137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:27.035136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.035618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.036058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:27.036739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.037187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.037642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:27.165412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:27.171140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2864f4af-3df8-4f72-856f-8488f0e2f7e9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1508 microversion: 2.1 time: 0.146731 Sep 26 18:01:27.171708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 283/595] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:27 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:27.881363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:27.882671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:27.885698 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:27.886399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:27.887526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:27.890740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.891462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.891895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:27.892584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.893255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.893667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:27.894690 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.895395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.896005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:27.897170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:27.898580 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:27.899165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:28.091554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:28.099835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-33dbe2d4-d9b2-4b5c-818a-c8b0c3c0ab77 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.224100 Sep 26 18:01:28.101678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 313/596] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:27 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:28.113784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:28.123048 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:28.124540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:28.125730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2564a39a-d51f-4ff9-937a-58c3315f5b3b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.245667 Sep 26 18:01:28.126276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 284/597] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:27 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:28.539726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "name": "network-vif-plugged", "status": "completed", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:28.549927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:28.550489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:28.550919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:28.563421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] Creating event network-vif-plugged:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 18:01:28.570835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-4830b7c9-28b3-4a25-8c03-44f713640c42 req-7913de94-3e5a-41a0-84a4-8efcc147b2a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Sep 26 18:01:28.571495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 314/598] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:01:29.123562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:29.124199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:29.130648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:29.131143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:29.131621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:29.132264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:29.133389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:29.133810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:29.153021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:29.153746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:29.159828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:29.160313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:29.160758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:29.161476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:29.161933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:29.162365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:29.338840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:29.354658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-90215e53-7c0e-412b-9a10-305403f6aef3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.234661 Sep 26 18:01:29.355011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:29.355607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 285/599] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:29 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:29.364817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:29.366414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:29.367627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-97b7a52f-bab5-4270-9ca5-836e99fad5d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.219620 Sep 26 18:01:29.368184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 315/600] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:29 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:30.381702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:30.382243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:30.388842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:30.389363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:30.389803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:30.390489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:30.390944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:30.391369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:30.394110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:30.394795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:30.401208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:30.401792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:30.402532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:30.403237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:30.403753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:30.404181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:30.590553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:30.597413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:30.598783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dd13e022-0221-4d8a-9644-f7a834f04654 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.221010 Sep 26 18:01:30.599358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 286/601] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:30 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:30.607021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:30.608486 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:30.609652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aeeb056f-3cfa-4713-a6b8-d618eac6facb tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.219799 Sep 26 18:01:30.610336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 316/602] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:30 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:31.556527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:31.557123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:31.563371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.563859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.564295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.564982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.565467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.565895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.624619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:31.625267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:31.631451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.631936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.633006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.633645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.634105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.634536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.694543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'services' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:01:31.764608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:31.768500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:31.775426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8c88254b-9efd-42f1-89e5-265d6f37f7c0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.155408 Sep 26 18:01:31.776009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 317/603] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:31 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:31.780841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:31.781469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:31.787244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.787894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.788995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.789887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:31.790334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:31.790948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:31.922265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:31.931674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:31.933140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:31.934481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cbd44a34-9a5e-43c2-b4f5-cdaac38fb267 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.157561 Sep 26 18:01:31.935044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 318/604] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:31 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:31.954683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6a4b4f21-ae24-42f5-bcb1-792bc4d6e026 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments/92adca05-61a9-44b4-a8f6-99412924bae9" status: 202 len: 0 microversion: 2.1 time: 0.402409 Sep 26 18:01:31.955287 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 287/605] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:01:31 2022] DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments/92adca05-61a9-44b4-a8f6-99412924bae9 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:01:32.799907 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:32.800549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:32.806952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:32.807433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:32.807865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:32.808549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:32.809001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:32.809451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:32.937615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:32.946381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5c1f43e8-010b-4f60-83f1-40e801ee2838 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.150447 Sep 26 18:01:32.946942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 319/606] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:32 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:32.963062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:32.967815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:32.970056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:32.970538 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:32.970971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:32.971661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:32.972115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:32.972547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:33.114653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:33.123818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:33.125298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:33.126460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-11ef385b-f129-4b73-b6f3-0cb3545086b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.168247 Sep 26 18:01:33.127007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 288/607] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:32 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:33.969153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:33.969806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:33.976822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:33.977346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:33.977781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:33.979010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:33.979529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:33.979985 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:34.112384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:34.121414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0fcf9c9c-86ee-41ba-be1e-8a21b1132cf6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.156094 Sep 26 18:01:34.122065 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 320/608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:33 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:34.151404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:34.152028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:34.158579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:34.159054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:34.159484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:34.160158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:34.160607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:34.161019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:34.291502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:34.300244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:34.301720 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:34.302877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6dd67d98-74ce-4ba2-919f-6a05c9b1d5d9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.155272 Sep 26 18:01:34.303429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 289/609] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:34 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:35.143894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:35.144519 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:35.151614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:35.152141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:35.152849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:35.153808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:35.154446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:35.155056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:35.301295 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:35.309483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8cd625f8-4766-440b-b683-23dc7f2eaca4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.169513 Sep 26 18:01:35.311894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 321/610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:35 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:35.327733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:35.328338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:35.335180 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:35.336114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:35.336558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:35.337257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:35.337748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:35.340692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:35.471808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:35.491043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:35.492567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:35.493773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-763be0e1-f912-4228-bb1f-ce465ddce410 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.169921 Sep 26 18:01:35.494767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 290/611] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:35 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:36.333102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:36.333680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:36.340116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.340601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.341037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.341757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.342210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.342636 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.477974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:36.486154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-de52965a-4afc-4888-a6e4-3491464bec82 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.156985 Sep 26 18:01:36.486714 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 322/612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:36 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:36.521419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:36.522386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:36.528926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.530031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.530668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.531484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.532081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.532836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.549903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:36.682981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:36.693807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:36.695462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:36.696705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a8ad24a6-9350-4eb9-8a50-f0141ebe40e0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1808 microversion: 2.20 time: 0.180279 Sep 26 18:01:36.697565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 291/613] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:36 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:36.704639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:36.705280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:36.711945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.719240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.719240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.719240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:36.719240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:36.719598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:36.850548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:36.859296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-831589d6-08d5-40aa-8e59-52aa473685c1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1594 microversion: 2.1 time: 0.158774 Sep 26 18:01:36.859867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 323/614] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:36 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:37.328547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:37.335338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.336365 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.336802 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.399688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Going to try to stop instance {{(pid=132948) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 18:01:37.510847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:37.511684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:37.518140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.523594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.523594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.523594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.523594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.524012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.651018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:37.659638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cdf53ce1-2769-4135-8d2e-17b8451793b0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.152644 Sep 26 18:01:37.660410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 324/615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:37 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:37.662079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2fd580c9-a971-4f20-b5f7-ef4f507f965e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action" status: 202 len: 0 microversion: 2.1 time: 0.337205 Sep 26 18:01:37.667102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 292/616] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:01:37 2022] POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:01:37.673594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:37.674473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:37.681807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.682579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.683203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.684069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.684688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.685109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.724494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:37.725166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:37.731681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.732161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.732962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.733303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:37.733837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:37.734229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:37.987124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:37.994988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3e55d050-5839-4270-86fc-1c7e025cb909 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.325757 Sep 26 18:01:37.995645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 325/617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:37 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:37.998529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:38.007886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:38.009361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:38.010592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bc78ee7b-ef3b-4f4c-ad55-667da3fcbd7b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1795 microversion: 2.20 time: 0.290497 Sep 26 18:01:38.011141 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 293/618] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:01:37 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1795 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:01:38.684013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:38.684678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:38.692310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:38.692776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:38.693368 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:38.698289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:38.698289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:38.698289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:38.854339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:38.862511 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a54480de-0907-4892-b792-51a52c7b7dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.182447 Sep 26 18:01:38.863076 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 326/619] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:38 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:39.018066 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:39.018959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:39.026061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:39.026549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:39.026987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:39.027957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:39.028414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:39.028841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:39.244964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:39.252714 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cc7d5944-dd9e-49c5-80bf-0447cc331507 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.238493 Sep 26 18:01:39.253301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 294/620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:39 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:39.565119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:39.575508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:39.575984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:39.582266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:39.606902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] Creating event network-changed:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:01:39.612103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-4f14253a-faa4-46cf-ad34-e36e809ea2df req-a3212b1d-3615-4181-b33b-cfbbb8e420ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054893 Sep 26 18:01:39.612713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 327/621] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:39.887464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:39.891001 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:39.895419 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:39.896017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:39.896547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:39.897482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:39.898111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:39.898598 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:40.042028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:40.051918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9eecae50-995d-4b0b-9881-b701f4a1e033 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.170440 Sep 26 18:01:40.055790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 295/622] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:39 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:40.280794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:40.282236 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:40.291807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:40.292324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:40.292781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:40.293510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:40.293964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:40.294384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:40.457175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:40.465677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-899bb3dc-e08e-41c1-ad55-7229b4b20486 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.193043 Sep 26 18:01:40.466262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 328/623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:40 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:41.076479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:41.077092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:41.083652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:41.084136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:41.084579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:41.085958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:41.086424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:41.086853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:41.264659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:41.275141 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-35b28992-c010-486e-ac04-b5081578fcbc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.202302 Sep 26 18:01:41.275751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 296/624] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:41 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:41.488714 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:41.489587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:41.497238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:41.497238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:41.497238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:41.497858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:41.498317 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:41.498747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:41.627631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:41.642734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aa9da988-9a18-471e-b166-19156afdcd20 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.157778 Sep 26 18:01:41.643338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 329/625] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:41 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:42.303918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:42.304566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:42.311683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.312301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.312875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.313670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.314144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.314757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.496216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:42.504863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-87e5d477-6efd-4a2d-bc90-cdd9b8b284c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.204756 Sep 26 18:01:42.505459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 297/626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:42 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:42.668075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:42.669102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:42.674734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.675203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.675630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.676309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.676755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.677172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.690579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-965062654"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:42.691114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:42.697147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.697663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.698099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.698858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:42.699288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:42.699733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:42.876949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:42.884684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-daabf37a-61c2-4cd6-b225-cbb0428557d3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.221056 Sep 26 18:01:42.885287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 330/627] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:42 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:42.888716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.network.security_group_api [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Adding security group 044f911f-1f6c-4070-a037-fa310154b3a8 to port 92394117-76f4-4f16-b60c-6adb351db3cd Sep 26 18:01:43.320831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a34f0b70-4bcd-458e-a074-761af5bba69c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action" status: 202 len: 0 microversion: 2.1 time: 0.634148 Sep 26 18:01:43.321444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 298/628] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:01:42 2022] POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:01:43.330052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:43.330675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:43.331405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:43.337119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.337635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.338195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.338893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.339342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.339760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.342342 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.342922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.343357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.355723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] Creating event network-changed:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:01:43.360851 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-86c027c5-febb-42d1-8dcf-230291b7212b req-fb1c1337-7983-46a2-aa99-924435fd68a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033306 Sep 26 18:01:43.364649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 299/629] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:01:43.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:43.504821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0343e345-c49f-463b-a668-305e7815a5a6 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1758 microversion: 2.1 time: 0.178831 Sep 26 18:01:43.505450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 331/630] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:43 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:43.530332 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:43.531046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:43.537290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.537786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.538245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.539058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.539517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.539968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.686394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:43.695797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8b1db643-0a9d-4a28-a97d-48a632617529 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.169533 Sep 26 18:01:43.696556 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 300/631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:43 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:43.912706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:43.914235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:43.924478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.925381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.926005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:43.926736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:43.927348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:43.927933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:44.064071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:44.071939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2c24e4a9-b7c5-499f-a771-d3b26a71de6f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.167293 Sep 26 18:01:44.072498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 332/632] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:43 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:44.720050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:44.720663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:44.727672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:44.728390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:44.729080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:44.729917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:44.730372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:44.730797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:44.862911 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:44.871938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-317904d7-3395-41f1-8ce4-0a056bfc853c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.155927 Sep 26 18:01:44.872559 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 301/633] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:44 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:45.096185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:45.096712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:45.103174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:45.103664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:45.104267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:45.104967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:45.105514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:45.105890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:45.234927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:45.243211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ee4d9b6e-197a-45ba-b41e-a098c428ea47 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.151052 Sep 26 18:01:45.243796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 333/634] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:45 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:45.896207 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:45.896759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:45.903423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:45.903900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:45.904334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:45.905017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:45.905497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:45.905918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:46.036133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:46.044817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2e664260-d299-4a50-b14e-d32abad801fb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.152557 Sep 26 18:01:46.045412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 302/635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:45 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:46.266243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:46.266857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:46.273373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:46.274020 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:46.274463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:46.275153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:46.275610 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:46.276036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:46.407777 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:46.416035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-55877999-3c95-4453-856b-a679ac572095 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.153781 Sep 26 18:01:46.416599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 334/636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:46 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:47.067664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:47.068315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:47.074744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:47.075217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:47.075647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:47.076321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:47.076768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:47.077184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:47.203276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:47.211873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-af0c5b85-e9e7-465d-8a4c-1a3801f7fe20 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.147995 Sep 26 18:01:47.212431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 303/637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:47 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:47.450171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:47.450171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:47.450171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:47.450171 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:47.451034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:47.451034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:47.451034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:47.451034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:47.453257 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:47.579401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:47.588161 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6913a581-4342-4153-b03f-ff6a44b9e040 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.153095 Sep 26 18:01:47.588729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 335/638] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:47 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:48.235889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:48.236503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:48.238966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=64 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:48.244239 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:48.244716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:48.245156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:48.245869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:48.246352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:48.246775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:48.373393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:48.381573 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-992003be-71ee-4977-8849-c14f5f8ab3ec tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.149522 Sep 26 18:01:48.382141 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 304/639] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:48 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:48.611401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:48.612057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:48.618856 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:48.619369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:48.619870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:48.620686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:48.621149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:48.621609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:48.763220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:48.770996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-36edc232-1e5d-49c0-a1e6-15b693e3445d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.163588 Sep 26 18:01:48.771552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 336/640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:48 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:49.409047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:49.409047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:49.412511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:49.412996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:49.413475 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:49.414216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:49.414671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:49.415097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:49.545196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:49.553491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d23e2acf-8f46-4e9c-baa5-356f23479c17 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.152396 Sep 26 18:01:49.554067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 305/641] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:49 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:49.794113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:49.794720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:49.801112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:49.801614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:49.802042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:49.802716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:49.803163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:49.803580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:49.931428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:49.939212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e77a386f-853b-4066-bbb1-23170722d44e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.148992 Sep 26 18:01:49.939779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 337/642] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:49 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:50.578462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:50.579071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:50.585479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:50.585959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:50.586393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:50.587074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:50.587525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:50.587946 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:50.721248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:50.730205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-58b7236f-04dd-4a05-bc95-4db02017fa4a tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.155668 Sep 26 18:01:50.730785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 306/643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:50 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:50.963510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:50.964126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:50.970609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:50.971003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:50.971440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:50.972131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:50.972592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:50.973023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:51.099578 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:51.107576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3ec0e058-cd1e-4e57-a19f-f622d68e2b6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.148029 Sep 26 18:01:51.108145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 338/644] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:50 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:51.753499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:51.754117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:51.761235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:51.761739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:51.762179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:51.762871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:51.763333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:51.763763 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:51.892331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:51.900879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d9354383-379f-49bc-9c35-fa7db7f24d6e tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.151240 Sep 26 18:01:51.901477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 307/645] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:51 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:52.131495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:52.132102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:52.138968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:52.139442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:52.139871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:52.140547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:52.140994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:52.141450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:52.269072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:52.276914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-118db352-9baf-41af-a7d5-773569cd004a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.149397 Sep 26 18:01:52.277767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 339/646] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:52 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:52.925581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:52.926165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:52.933348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:52.933836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:52.934371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:52.935061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:52.935517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:52.935945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:52.939815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:53.067009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:53.075202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0f7dd3d9-61da-46b7-836e-2df793378ee6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1736 microversion: 2.1 time: 0.153620 Sep 26 18:01:53.075771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 308/647] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:52 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:53.299649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:53.300267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:53.302696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=66 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:53.307402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:53.308006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:53.308352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:53.309046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:53.309536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:53.309964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:53.444361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:53.452270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2ea64e7c-70ab-4202-8484-df3e4a3f175c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1675 microversion: 2.1 time: 0.156391 Sep 26 18:01:53.452907 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 340/648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:53 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:54.099791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:54.100440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:54.107656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.108138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.108574 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.109283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.109745 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.110200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.237959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:54.246619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e2053911-9003-4d26-a9aa-406714256247 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1716 microversion: 2.1 time: 0.151110 Sep 26 18:01:54.247183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 309/649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:54 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:54.356784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:54.357310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:54.363704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.364182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.364619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.365343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.365800 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.366224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.409055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2f9f5e0-6ea3-47ab-ab01-7e6fbfda1b69", "device": "/dev/sdb"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:54.412031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:54.419028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.419028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.419028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.419614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.420078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.420506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.496529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] HTTP exception thrown: Cannot 'detach_volume' instance 26523d3d-340f-4fcc-8594-b8033312e8b2 while it is in vm_state rescued Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Request method failure captured: Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments/1a5fc7c7-ff41-46cf-94a3-aba081618168 HTTP/1.1 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKNAjit7s3pSDX4eZsJuiExXyG9ODWhNqywnJvUzWbeIhOvLWYNNS1U26Kp05e7c-OIx67D5mGH0cCXXu8YGoJJQoCKGs6H03kBDsZCbgHDoy28bv2GsRi4j0ceA2pjH1qv85HSfImoJQAXxG1kvk6xkXz3ixMAcQZC8x1d-Prmn4 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:01:54.498196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/222cdd96fb334e63a823cab0d33f939f"}]}] Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0416809c467846428e7df9a7c11ffb0e Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:01:54.499769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Cannot 'detach_volume' instance 26523d3d-340f-4fcc-8594-b8033312e8b2 while it is in vm_state rescued Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'server_id': '26523d3d-340f-4fcc-8594-b8033312e8b2', 'id': '1a5fc7c7-ff41-46cf-94a3-aba081618168'} Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:01:54.500529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 26523d3d-340f-4fcc-8594-b8033312e8b2 while it is in vm_state rescued Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 26523d3d-340f-4fcc-8594-b8033312e8b2 while it is in vm_state rescued Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:01:54.501799 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Returning 409 to user: Cannot 'detach_volume' instance 26523d3d-340f-4fcc-8594-b8033312e8b2 while it is in vm_state rescued {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:01:54.502754 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ca15cc77-4f69-4a42-8379-768290063204 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments/1a5fc7c7-ff41-46cf-94a3-aba081618168" status: 409 len: 152 microversion: 2.1 time: 0.146842 Sep 26 18:01:54.502754 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 341/650] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:01:54 2022] DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments/1a5fc7c7-ff41-46cf-94a3-aba081618168 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 18:01:54.506035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:54.506681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:54.514089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.514574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.515016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.515710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.516170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.516629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.652064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:54.660553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fbf49163-62d6-4869-bc20-256dfbc8218f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1652 microversion: 2.1 time: 0.158048 Sep 26 18:01:54.670488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 342/651] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:54 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:54.670488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:54.670488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:54.673240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.673366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.673755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.674462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.674924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.675352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.877975 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-20071c4e-0d16-4bb2-bbfd-a8cc3135d770 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.215593 Sep 26 18:01:54.878662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 343/652] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:01:54 2022] POST /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:01:54.883946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:54.890279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:54.890699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:54.891137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:54.914879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Going to try to start instance {{(pid=132949) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 18:01:55.135223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2d820982-9ecf-4cf3-bf1c-ff18c6badf6c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action" status: 202 len: 0 microversion: 2.1 time: 0.255084 Sep 26 18:01:55.143679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 344/653] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:01:54 2022] POST /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:01:55.146500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:55.147210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:55.154223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:55.154709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:55.155148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:55.155850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:55.156301 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:55.156726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:55.288028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:55.304106 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-76a70730-9514-49fe-89ff-2c63b9301064 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1724 microversion: 2.1 time: 0.163723 Sep 26 18:01:55.304786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 345/654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:55 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:55.309548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:55.312653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:55.316096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:55.316582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:55.317014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:55.317743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:55.318194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:55.318617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:55.338748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5b129872-4009-44dd-bcfe-2eac9810d85e tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "POST /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933361 Sep 26 18:01:55.339368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 310/655] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:01:54 2022] POST /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:01:55.466242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:55.475105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3a97b93c-1689-4710-89cf-13f43cbb88e5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1661 microversion: 2.1 time: 0.169197 Sep 26 18:01:55.475682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 346/656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:55 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:56.328980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:56.329728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:56.335936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:56.336417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:56.336855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:56.337641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:56.338096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:56.338522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:56.475127 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:56.484231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d41e0789-e776-466d-8a67-6e4624474cfa tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1724 microversion: 2.1 time: 0.159950 Sep 26 18:01:56.487689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 311/657] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:56 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:56.497733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:56.498350 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:56.504927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:56.505459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:56.505908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:56.506604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:56.507061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:56.507490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:56.633773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:56.641552 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2655a164-7f9e-4a88-ba65-13f3accc08da tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1661 microversion: 2.1 time: 0.147759 Sep 26 18:01:56.642115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 347/658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:56 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1661 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:57.509340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:57.509959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:57.516284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:57.516773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:57.517211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:57.517971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:57.518430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:57.518859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:57.646610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:57.655642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7509f2c7-b4d8-4f4f-b827-f866f1b071c9 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1724 microversion: 2.1 time: 0.150074 Sep 26 18:01:57.656140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 312/659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:57 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:57.665174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:57.667095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:57.673011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:57.673531 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:57.673972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:57.674669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:57.675124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:57.675554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:57.801754 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:57.809307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-55acaee4-bb02-4f3c-975d-cd1e7385b72e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1661 microversion: 2.1 time: 0.147898 Sep 26 18:01:57.809873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 348/660] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:57 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1661 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:58.678607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:58.679225 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:58.686164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.686652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.687093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.687783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.688241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.688671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.818971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:58.827600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-65a06b9e-13bc-4f87-9bf4-c6015eeb8dda tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1730 microversion: 2.1 time: 0.152831 Sep 26 18:01:58.828164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 313/661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:58 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:58.832409 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:58.833018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:58.839620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.840097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.840526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.841201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.841668 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.842084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.849979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:58.850471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:01:58.856894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.857451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.857893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.858606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:58.859062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:58.859487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:58.975321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f78159b2-0f1b-400d-a569-b426cbc32ec0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129035 Sep 26 18:01:58.975939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 314/662] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:01:58 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:59.006382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:01:59.009904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:59.014510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7c5f72cc-f0ca-473a-91bb-1c8c80e55510 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1661 microversion: 2.1 time: 0.185883 Sep 26 18:01:59.015074 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 349/663] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:01:58 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:01:59.947438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:01:59.958296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:59.959086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:59.959729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:59.971678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] Creating event network-changed:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 18:01:59.977118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-b58b5b7c-0202-4486-94eb-80bb22e30986 req-9cf827ee-34af-43cc-a2a1-1fb3f2533039 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Sep 26 18:01:59.978013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 315/664] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:00.037893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:00.038528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:00.045392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:00.045821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:00.046257 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:00.046952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:00.047405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:00.047823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:00.195268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:00.205200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8b2a314b-ae1f-440f-8f49-77f760fd40f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1665 microversion: 2.1 time: 0.171397 Sep 26 18:02:00.205834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 350/665] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:00 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:01.992511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:02.002023 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:02.002500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:02.002932 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:02.014254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] Creating event network-changed:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 18:02:02.019052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-7eb9af6d-43bd-4de3-bd51-85aa94d384bf req-0260f6e3-cbbd-4cbd-8a69-7dc1ce5589c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031215 Sep 26 18:02:02.019624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 316/666] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:07.476475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:07.477067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:07.484035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.484521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.484961 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.485695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.486151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.486578 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.509825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9ed11cca-5273-4bc4-bf38-faf1b3640ea4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/ips" status: 200 len: 150 microversion: 2.1 time: 0.037422 Sep 26 18:02:07.510400 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 351/667] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 18:02:07 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:07.523762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "364eb9ca-f439-48db-999b-80280d36a062"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:07.526326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:07.532569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.533044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.533506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.534186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.534634 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.535059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.613343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: POST /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/os-volume_attachments HTTP/1.1 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 74 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:02:07.615363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {"volumeAttachment": {"volumeId": "364eb9ca-f439-48db-999b-80280d36a062"}} Sep 26 18:02:07.616905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'server_id': 'ae9a9e8a-7083-4630-b3a3-f06226a6b58f', 'body': {'volumeAttachment': {'volumeId': '364eb9ca-f439-48db-999b-80280d36a062'}}} Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:07.617898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:07.619438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 400 to user: Invalid volume: volume 364eb9ca-f439-48db-999b-80280d36a062 is already attached to instances: 158e230e-aa1a-4311-81fc-5815c8cf0f64 {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d156b66d-a806-46ba-b9d6-a9dcb3a95a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097942 Sep 26 18:02:07.621640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 317/668] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:02:07 2022] POST /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:02:07.626205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:07.626715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:07.632769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.633306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.633772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.634460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.634915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.635339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.661185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:02:07.943442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-01370a12-6f05-413b-acc1-fe0994fed9af tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 204 len: 0 microversion: 2.1 time: 0.320713 Sep 26 18:02:07.944028 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 352/669] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:02:07 2022] DELETE /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:02:07.952212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:07.952833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:07.959668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.960149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.960589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:07.961314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:07.961775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:07.962203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:08.089826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:08.097541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-43d43201-00a5-4562-8ff0-7b94d20fe4a5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.149033 Sep 26 18:02:08.098092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 318/670] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:07 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:09.124001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:09.124704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:09.131070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:09.131559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:09.131992 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:09.132683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:09.133134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:09.133583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:09.260416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:09.268005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b8bf355d-28a6-49ab-a63c-99b80ba29940 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.148679 Sep 26 18:02:09.268567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 353/671] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:09 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:10.290828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:10.291509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:10.298456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:10.298939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:10.299376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:10.300067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:10.300525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:10.300950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:10.433152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:10.440743 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8715a84d-4a1a-4362-8aac-fe5e7c676ff1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.153775 Sep 26 18:02:10.441318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 319/672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:10 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:11.469108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:11.470048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:11.477090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:11.477585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:11.478020 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:11.478716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:11.479179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:11.480113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:11.612435 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:11.620861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-355981e8-6d55-46b2-b3b7-bd521c6c4969 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.155246 Sep 26 18:02:11.621463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 354/673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:11 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:12.643695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:12.644307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:12.650994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:12.651485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:12.651922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:12.652869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:12.653370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:12.653803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:12.783903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:12.791632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d024aaae-ea43-4767-96df-370e65972ad5 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.151651 Sep 26 18:02:12.792347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 320/674] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:12 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:13.814866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:13.815512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:13.822034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:13.822521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:13.822957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:13.823641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:13.824090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:13.824514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:13.951909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:13.959448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-300b0605-999e-41a0-a718-497080dd4c7f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.148424 Sep 26 18:02:13.960009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 355/675] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:13 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:14.983973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:14.984486 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:14.990788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:14.991260 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:14.991690 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:14.992361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:14.992805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:14.993240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:15.233946 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:15.241818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-152bda9d-f2da-4f1e-9d41-d6b180ea2b6c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1682 microversion: 2.1 time: 0.261718 Sep 26 18:02:15.242320 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 321/676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:14 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:16.265915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:16.271480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:16.271604 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9a9e8a-7083-4630-b3a3-f06226a6b58f", "name": "network-vif-deleted", "tag": "16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:16.280611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:16.281121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:16.283464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:16.284373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:16.285172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:16.285848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:16.285960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:16.286343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:16.286762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:16.299100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] Creating event network-vif-deleted:16d7da5a-4ee1-4bc2-9dbc-207c4b1bd786 for instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f on hv-cinder-85931 Sep 26 18:02:16.305282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-b80b70ae-7529-4962-9096-ef77054c2aaf req-dda1f5ae-b70a-44d3-934e-54306358ebd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048163 Sep 26 18:02:16.306278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 356/677] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:16.354100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:16.362554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0abc7a59-ba88-4b82-a98d-3dace18d4ca3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1614 microversion: 2.1 time: 0.100347 Sep 26 18:02:16.363163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 322/678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:16 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:17.388334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:17.389735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:17.396496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:17.397014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:17.397510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:17.398223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:17.398680 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:17.399109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:17.435112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:17.435603 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:17.436072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:17.436587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'fault' on Instance uuid ae9a9e8a-7083-4630-b3a3-f06226a6b58f {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:17.544200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:17.551960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3f777b54-ad9f-4b79-a520-0ec10f099169 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 200 len: 1331 microversion: 2.1 time: 0.168553 Sep 26 18:02:17.552536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 357/679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:17 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:18.575403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:18.576019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:18.578493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=38 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:18.583205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:18.584754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:18.584754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:18.584953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:18.585254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:18.585751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:18.599201 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f HTTP/1.1 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:02:18.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:02:18.602212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'ae9a9e8a-7083-4630-b3a3-f06226a6b58f'} Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:02:18.602981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:02:18.604470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:18.606773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:02:18.606773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fe782386-de05-4d29-83e5-71b13d84ef78 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 404 len: 111 microversion: 2.1 time: 0.030688 Sep 26 18:02:18.606773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 323/680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:18 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:02:18.612006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-65e23837-d5b3-4bc0-b392-820055952d7a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '.version_select at 0x7ff981df9280>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:18.784564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-65e23837-d5b3-4bc0-b392-820055952d7a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423628835" status: 202 len: 0 microversion: 2.1 time: 0.176445 Sep 26 18:02:18.785167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 358/681] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 18:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423628835 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:19.288241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:19.288766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:19.294667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:19.295158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:19.295588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:19.296284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:19.296741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:19.297161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:19.387639 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'services' on Instance uuid d0845f91-ab86-4e38-86cc-14451ecc1392 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:19.691486 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2801375e-29cb-4921-926c-ecee0a2ac2be tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392/os-volume_attachments/d2f9f5e0-6ea3-47ab-ab01-7e6fbfda1b69" status: 202 len: 0 microversion: 2.1 time: 0.407404 Sep 26 18:02:19.692174 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 324/682] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:02:19 2022] DELETE /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392/os-volume_attachments/d2f9f5e0-6ea3-47ab-ab01-7e6fbfda1b69 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:19.912926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:19.913442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:19.920861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:19.932462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:19.932462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:19.932462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:19.932462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:19.932893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:20.002430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'services' on Instance uuid 158e230e-aa1a-4311-81fc-5815c8cf0f64 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:20.280225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8886d54a-13d2-496f-83f4-aa1cc60f3b04 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments/364eb9ca-f439-48db-999b-80280d36a062" status: 202 len: 0 microversion: 2.1 time: 0.371075 Sep 26 18:02:20.280806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 359/683] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:02:19 2022] DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments/364eb9ca-f439-48db-999b-80280d36a062 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:20.289869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:20.292269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:20.299008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:20.299474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:20.299935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:20.300614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:20.301067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:20.301505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:20.305127 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:20.331956 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a841172d-1b71-4522-92d4-75f4e743b20e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Sep 26 18:02:20.332498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 325/684] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:20 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:21.345915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:21.348085 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:21.354277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:21.354763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:21.355694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:21.356382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:21.356839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:21.357293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:21.386736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1540048f-f52f-42f4-944e-0a9173946e93 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Sep 26 18:02:21.387293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 360/685] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:21 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:21.880807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:21.881384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:21.890967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:21.891447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:21.891882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:21.892568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:21.893022 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:21.893599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:21.917910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:02:22.297587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-074921e6-87fb-49a7-9c56-ace529b48b45 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 204 len: 0 microversion: 2.1 time: 0.420645 Sep 26 18:02:22.298177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 326/686] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:02:21 2022] DELETE /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:02:22.306474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:22.307125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:22.313782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.314267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.314704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.315394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.315849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.316276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.399719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:22.402781 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:22.408732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.409397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.409839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.410539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.410992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.411512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.441643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eb686842-b5d4-40da-a5b0-a722ef15c57a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046129 Sep 26 18:02:22.442396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 327/687] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:22 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 18:02:22.448050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:22.456280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2da1a728-214f-4ef7-aa00-e0cea7c33586 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1514 microversion: 2.1 time: 0.153615 Sep 26 18:02:22.457047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 361/688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:22 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:22.507135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:22.507638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:22.513797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.514277 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.514716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.515411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.515868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.516294 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.541090 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:02:22.880026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cb2da833-fad7-4395-82eb-e688e8af9477 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 204 len: 0 microversion: 2.1 time: 0.376444 Sep 26 18:02:22.880603 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 328/689] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:02:22 2022] DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:02:22.889080 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:22.889733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:22.895549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.896020 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.897320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:22.897320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:22.897591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:22.898007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:23.026311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:23.034514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-33069565-d3d3-474d-b0f3-64319282d0c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1680 microversion: 2.1 time: 0.149728 Sep 26 18:02:23.035080 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 362/690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:22 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:23.482304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:23.483016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:23.489369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:23.489859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:23.490305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:23.491000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:23.491457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:23.491916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:23.620349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:23.628067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-65c42aa0-5153-40b5-9713-be7142e7ee33 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1514 microversion: 2.1 time: 0.150773 Sep 26 18:02:23.628652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 329/691] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:23 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:24.057590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:24.058782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:24.061312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:24.066085 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:24.066837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:24.067039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:24.067732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:24.068191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:24.068620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:24.199556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:24.207300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d249be2e-23b7-4b19-8deb-137023927ee3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1680 microversion: 2.1 time: 0.153739 Sep 26 18:02:24.207860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 363/692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:24 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:24.651524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:24.652927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:24.659347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:24.659832 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:24.660271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:24.660962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:24.661485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:24.661917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:24.789411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:24.797885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-84886f77-e438-4209-91d3-0f2abde0bed3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1514 microversion: 2.1 time: 0.150254 Sep 26 18:02:24.798454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 330/693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:24 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:25.229507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:25.230127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:25.236517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:25.237002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:25.237479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:25.238172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:25.238628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:25.239060 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:25.367890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:25.375735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-10cf4a72-a925-4a3f-a665-de5959a427a3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1680 microversion: 2.1 time: 0.150187 Sep 26 18:02:25.376299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 364/694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:25 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:25.821623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:25.822244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:25.828673 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:25.829156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:25.829625 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:25.830318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:25.830775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:25.831206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:25.956151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:25.965048 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a5ae8b51-e5dc-4158-9582-dd4599ec45ef tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1514 microversion: 2.1 time: 0.147526 Sep 26 18:02:25.965637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 331/695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:25 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:26.399577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:26.400205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:26.407783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:26.408272 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:26.408705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:26.409501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:26.409956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:26.410378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:26.553485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:26.556909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:26.561618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3d102455-6e10-41c4-8860-afcb2246644d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1680 microversion: 2.1 time: 0.165935 Sep 26 18:02:26.562184 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 365/696] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:26 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:26.987768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:26.988477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:26.994975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:26.996040 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:26.996486 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:26.997279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:26.997676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:26.998105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:27.067035 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:27.076438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1f63a89f-ed7d-4ce4-8c52-2aa413e2fd9c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1472 microversion: 2.1 time: 0.092238 Sep 26 18:02:27.077034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 332/697] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:26 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:27.113283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0845f91-ab86-4e38-86cc-14451ecc1392", "name": "network-vif-deleted", "tag": "eb392aee-4e73-4b08-bf94-37264b5f28aa"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:27.124068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:27.124838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:27.125561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:27.137565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] Creating event network-vif-deleted:eb392aee-4e73-4b08-bf94-37264b5f28aa for instance d0845f91-ab86-4e38-86cc-14451ecc1392 on hv-cinder-85931 Sep 26 18:02:27.142890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-f6008cef-2c46-4355-8cf0-50f22d7595ae req-0e7a4989-4daf-4cf1-a5f0-a4441ace04b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033354 Sep 26 18:02:27.143579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 366/698] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:27.585572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:27.586130 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:27.592242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:27.592751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:27.593181 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:27.593913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:27.594373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:27.594803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:27.723291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:27.731715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7fdefb73-c24c-45d7-848c-98d926991f6a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1680 microversion: 2.1 time: 0.150070 Sep 26 18:02:27.732397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 333/699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:27 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:28.102706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:28.103481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:28.114191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.120563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.120563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.120563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.120563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.122991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.164660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.165164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.165632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.166078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'fault' on Instance uuid d0845f91-ab86-4e38-86cc-14451ecc1392 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:28.217846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:28.228670 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a7910716-5e78-4443-9216-722fed15c5a3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 200 len: 1309 microversion: 2.1 time: 0.132430 Sep 26 18:02:28.230313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 367/700] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:28 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:28.755892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:28.757685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:28.763785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.764274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.764712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.765446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.765906 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.766396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.801134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:28.801665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:28.802102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:28.802563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'fault' on Instance uuid 158e230e-aa1a-4311-81fc-5815c8cf0f64 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:28.848252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:28.856916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7c6624e0-d360-4eb4-ad5a-512799f44397 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1331 microversion: 2.1 time: 0.104815 Sep 26 18:02:28.857529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 334/701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:28 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:29.172438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158e230e-aa1a-4311-81fc-5815c8cf0f64", "name": "network-vif-deleted", "tag": "dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:29.182403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.182878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.183312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.194057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] Creating event network-vif-deleted:dcbd42a1-e75a-43a9-b106-5a1eefbd6d3a for instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 on hv-cinder-85931 Sep 26 18:02:29.198818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-8a2f6368-cca2-4c90-a36e-4310e9182ec6 req-3a5ef741-157c-4e5f-b294-ade77b79d9ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030089 Sep 26 18:02:29.199404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 368/702] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:29.251998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:29.252555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: d0845f91-ab86-4e38-86cc-14451ecc1392] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:29.258945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.259449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.259889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.260709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.261948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.261948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.275011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] HTTP exception thrown: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Request method failure captured: Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 HTTP/1.1 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMejYsqovqP4rOfhIM_Z4o6WWg_peMfeLioQ0SHTnrKBJqpbXSvdspnTSVbA0Dl5rQlUhK5Wu3OR2IAV0Dpg-QTjnLCRRGqgx9V9ZxTonT6iYKJrMZWTBgcQU-m6oHXJgTwUgIO3lGTEGcXtE8mImHeYODVZIF96yBwoKmNTvq1ZCz94 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 7407b259f9ce40558c02a60e29e50c93 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:02:29.277619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7407b259f9ce40558c02a60e29e50c93"}]}] Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 7407b259f9ce40558c02a60e29e50c93 Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-VolumesSnapshotTestJSON-1293169270-project Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 6220cf71845241c2ad61cf77e2ea9fe9 Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-VolumesSnapshotTestJSON-1293169270-project Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. Sep 26 18:02:29.279149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'd0845f91-ab86-4e38-86cc-14451ecc1392'} Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:02:29.280024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. Sep 26 18:02:29.281568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:29.282827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Returning 404 to user: Instance d0845f91-ab86-4e38-86cc-14451ecc1392 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:02:29.282827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-79d2cbff-a963-4428-9cf9-fcb3ff277eb1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392" status: 404 len: 111 microversion: 2.1 time: 0.031084 Sep 26 18:02:29.282827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 335/703] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:29 2022] GET /compute/v2.1/servers/d0845f91-ab86-4e38-86cc-14451ecc1392 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:02:29.885169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:29.886403 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:29.892566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.893050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.893530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.894241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.894703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.895129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.929626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.930044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.930481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.930936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'fault' on Instance uuid 158e230e-aa1a-4311-81fc-5815c8cf0f64 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:29.973774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:29.982948 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-07564c25-09b1-4500-8340-e587e93de3df tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 200 len: 1331 microversion: 2.1 time: 0.102134 Sep 26 18:02:29.983529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 369/704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:29 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:31.005903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:31.006498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:31.013525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:31.014005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:31.014438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:31.015126 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:31.015577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:31.015999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:31.029199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 HTTP/1.1 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:02:31.030748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:02:31.032271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '158e230e-aa1a-4311-81fc-5815c8cf0f64'} Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:02:31.033093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:02:31.034586 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:31.035829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:02:31.035829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6b20f3f2-f3ff-4450-b68e-980ac3e8342c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 404 len: 111 microversion: 2.1 time: 0.030102 Sep 26 18:02:31.035829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 336/705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:31 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:02:31.043808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-095e617b-3587-4524-94d4-487ce575f3c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '.version_select at 0x7ff981c7d160>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:31.155962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-095e617b-3587-4524-94d4-487ce575f3c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427134022" status: 202 len: 0 microversion: 2.1 time: 0.116414 Sep 26 18:02:31.156462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 370/706] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 18:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427134022 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:31.931677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f782d92-b633-42c2-a683-5c95018a2efd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: .version_select at 0x7ff981d4b550>, body: {"keypair": {"name": "tempest-keypair-443303247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrhFVVwH1cCPWl1CPzwGu8kKM9gZk2jyRGxplfdpMq/FnuE/jeeorUOan45SPk+0W2pgoM72QG3BvV4CmAM3FzRT7uq5uuaF7z/l+mBTNe4/D+S/m9l1amIkDJVeoet3g=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:31.947946 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-8f782d92-b633-42c2-a683-5c95018a2efd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:02:31.951981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-8f782d92-b633-42c2-a683-5c95018a2efd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:02:32.087548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8f782d92-b633-42c2-a683-5c95018a2efd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159680 Sep 26 18:02:32.088156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 337/707] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:02:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:34.640538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2000400241", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c4905c3-b6d4-4b95-988f-f86fad27c092"}], "security_groups": [{"name": "tempest-securitygroup--517240265"}], "key_name": "tempest-keypair-443303247", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:34.747323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] validate_networks() for [('5c4905c3-b6d4-4b95-988f-f86fad27c092', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:02:35.158554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:02:35.158996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:02:35.159464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:02:35.159868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:02:35.160274 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:02:35.168916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:35.169490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:35.170514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:35.171182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:35.171628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:35.172050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:35.188514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:02:35.192470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:02:35.203247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:02:35.205582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:02:35.357929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6885c6a9-43a1-456b-bb42-7000ba6f4baf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.721796 Sep 26 18:02:35.358581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 371/708] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:02:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:02:35.371207 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3cf1b90d-8692-45ff-bdc2-a28fb19f3ce7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:35.371962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3cf1b90d-8692-45ff-bdc2-a28fb19f3ce7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:35.427860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3cf1b90d-8692-45ff-bdc2-a28fb19f3ce7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:35.434868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3cf1b90d-8692-45ff-bdc2-a28fb19f3ce7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1241 microversion: 2.1 time: 0.069009 Sep 26 18:02:35.435609 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 338/709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:35 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:36.457361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a0f0393f-b49a-47bf-b60b-65960810a628 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:36.457978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a0f0393f-b49a-47bf-b60b-65960810a628 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:36.514576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a0f0393f-b49a-47bf-b60b-65960810a628 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:36.521544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a0f0393f-b49a-47bf-b60b-65960810a628 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1241 microversion: 2.1 time: 0.068277 Sep 26 18:02:36.522113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 372/710] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:36 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:37.545055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:37.545742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:37.552529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:37.553025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:37.553499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:37.554252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:37.554706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:37.555133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:37.616451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:37.624512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1caead78-0066-47d3-89c6-f6d2737f5ea9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1245 microversion: 2.1 time: 0.083654 Sep 26 18:02:37.625077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 339/711] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:37 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:38.029900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:38.032279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:38.038796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.039275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.039710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.040397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.040855 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.041320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.232017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-492068ef-8f47-4850-ba8c-5d879a4a145c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action" status: 202 len: 0 microversion: 2.1 time: 0.206139 Sep 26 18:02:38.232673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 373/712] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:02:38 2022] POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:38.240588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:38.241193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:38.247077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.247553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.247986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.248664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.249627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.258191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.386064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:38.394683 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-485192c2-f65f-4c22-8cc4-10b155b823d1 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1750 microversion: 2.1 time: 0.157906 Sep 26 18:02:38.395241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 340/713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:38 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:38.648088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:38.648941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:38.655362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.656536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.656978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.657707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:38.658327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:38.658609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:38.722041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:38.730736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-71ea7e33-fdf9-4650-8734-2180df0473fa tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1245 microversion: 2.1 time: 0.086290 Sep 26 18:02:38.730736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 374/714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:38 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:39.418740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:39.419359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:39.425821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:39.426311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:39.426751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:39.427446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:39.427942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:39.428329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:39.444694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:39.589617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:39.598897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f5602951-ccbd-45e6-b894-35fc5d08075b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1750 microversion: 2.1 time: 0.184053 Sep 26 18:02:39.599717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 341/715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:39 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:39.753273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:39.754044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:39.760704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:39.761194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:39.761662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:39.762363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:39.762818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:39.763290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:39.828834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:39.837336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c399d917-f5bc-4016-8ab8-1a5fdc35029b tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1293 microversion: 2.1 time: 0.088836 Sep 26 18:02:39.845214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 375/716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:39 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:39.930505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-23852792", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "networks": [{"uuid": "916bf790-1a83-44fc-a77a-94ae8e7ef414"}]}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:39.984347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] validate_networks() for [('916bf790-1a83-44fc-a77a-94ae8e7ef414', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:02:40.231781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.232280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.238698 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.244595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.244595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.244595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.244595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.244986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.272334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5d55a9c5-7bcc-4046-9cff-b9d9e9f0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments/2d9a4625-b622-41f8-9bc9-2d4bb62bcff8" status: 200 len: 194 microversion: 2.20 time: 0.151900 Sep 26 18:02:40.272910 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 376/717] 10.222.0.49 () {60 vars in 1454 bytes} [Mon Sep 26 18:02:40 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments/2d9a4625-b622-41f8-9bc9-2d4bb62bcff8 => generated 194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 18:02:40.343031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.347573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.349372 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.349863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.350303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.350993 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.351444 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.351870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.384215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:02:40.384666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:02:40.385190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:02:40.385623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:02:40.386033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:02:40.395306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.395779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.396211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.396969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.397505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.397965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.414856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Getting quotas for project 7407b259f9ce40558c02a60e29e50c93. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:02:40.418915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Getting quotas for user 6220cf71845241c2ad61cf77e2ea9fe9 and project 7407b259f9ce40558c02a60e29e50c93. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:02:40.433623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:02:40.434362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lazy-loading 'services' on Instance uuid 9689462a-a796-4f06-b20f-00ba7a46cace {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:40.435003 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:02:40.545573 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9563b0b3-0327-4eb7-8637-16d1af4ee627 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618839 Sep 26 18:02:40.546484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 342/718] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:02:40.557329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0c61188e-8099-4ee3-8667-a1abe0fda32f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.558076 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0c61188e-8099-4ee3-8667-a1abe0fda32f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.616032 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0c61188e-8099-4ee3-8667-a1abe0fda32f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:40.625525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0c61188e-8099-4ee3-8667-a1abe0fda32f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1217 microversion: 2.1 time: 0.071917 Sep 26 18:02:40.626183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 343/719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:40 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:40.631047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.631661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.637927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.638340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.638765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.639477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.640513 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.640949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.707271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d32f907b-927a-4f9f-a594-6b7b061a5449 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments/2d9a4625-b622-41f8-9bc9-2d4bb62bcff8" status: 202 len: 0 microversion: 2.20 time: 0.367928 Sep 26 18:02:40.707929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 377/720] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 18:02:40 2022] DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments/2d9a4625-b622-41f8-9bc9-2d4bb62bcff8 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:02:40.719413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.733300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.743151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.743645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.745007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.745761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.746365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.751474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.806008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5903b7be-dbd7-4937-8824-59faf3b83e35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091421 Sep 26 18:02:40.806694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 378/721] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 18:02:40 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:02:40.845760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:40.854080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-467354e7-eb03-4bfe-8e99-45aada87627d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.226593 Sep 26 18:02:40.854644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 344/722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:40 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:40.866297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:40.867271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:40.873681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.874313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.877822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.877822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:40.877822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:40.877822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:40.938955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:40.946629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6f1e9de4-1691-4c5d-8060-a38f1a88d51c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1301 microversion: 2.1 time: 0.084273 Sep 26 18:02:40.947190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 379/723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:40 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:41.648790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:41.653640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:41.661074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.661600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.662079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.662818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.663276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.663706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.726898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:41.734958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d4e307de-9c8e-4300-8952-60d34f25b01c tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1221 microversion: 2.1 time: 0.089972 Sep 26 18:02:41.740204 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 345/724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:41 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:41.819440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:41.821885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:41.828501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.831963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.831963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.831963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.831963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.832338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.863357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6c6e6797-2f30-4f58-9eaf-2b9732d291a8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047873 Sep 26 18:02:41.864503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 380/725] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 18:02:41 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:02:41.878678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:41.881405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:41.885327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.885811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.886255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.887573 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.888032 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.888460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.973533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:41.974465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:41.981613 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.982321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.982941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:41.984485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:41.985091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:41.985723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.083820 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:42.098251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-74f5d0ca-b55a-46ec-b663-afdf628522ce tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.223070 Sep 26 18:02:42.099259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 346/726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:41 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:42.154556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:42.162837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-53189655-04c0-414c-bfa0-ae09d8dce6f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.196551 Sep 26 18:02:42.163336 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 381/727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:41 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:42.533764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921f12a9-6f62-478f-a547-9a46350096ae", "tag": "f5160b1d-20ef-4a96-9b5a-cc5148bd71f9"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:42.544274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.544857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.545423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.557991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] Creating event network-changed:f5160b1d-20ef-4a96-9b5a-cc5148bd71f9 for instance 921f12a9-6f62-478f-a547-9a46350096ae on hv-cinder-85931 Sep 26 18:02:42.564102 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-5f6d5051-717b-4eae-96a6-82a9e976b017 req-70174437-0984-417e-8315-23a0884d8572 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035165 Sep 26 18:02:42.564690 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 347/728] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:42.759157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:42.759783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:42.770944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.770944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.770944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.770944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.771255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.771255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.844811 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:42.850679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-52c44d76-9ff6-4883-88b2-b5a54dc63d6a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1269 microversion: 2.1 time: 0.096388 Sep 26 18:02:42.851436 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 382/729] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:42 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:42.877144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:42.880689 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:42.886431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.886998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.887511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.888289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.888812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.889372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.918317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-108b81be-eff8-46f5-aae0-890c6b00a38a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046106 Sep 26 18:02:42.918878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 348/730] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 18:02:42 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:42.984002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:42.988537 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:42.990358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.990841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.991280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:42.991976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:42.992428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:42.992857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.018824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:02:43.045150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:43.123047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:43.123663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:43.130311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.138221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.138221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.138221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.138221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.138569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.283488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.292168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d116a14d-494a-41a7-92f8-76609fd540b5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.172710 Sep 26 18:02:43.292447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 349/731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:43 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:43.297576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:43.298124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:43.304111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.309411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.309411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.309411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.309411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.309867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.435972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7ad1c812-8647-4bdc-9574-e72c5f7bd4f8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 204 len: 0 microversion: 2.20 time: 0.455727 Sep 26 18:02:43.437421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 383/732] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 18:02:42 2022] DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:02:43.446517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.446679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:43.447378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:43.455055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.455820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.456204 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a531dccb-78cc-4df9-b3aa-9ef3ddfb65f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.162646 Sep 26 18:02:43.456334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.457146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 350/733] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:43 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:43.457298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.457673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.458163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.590759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.598759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.600191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.601367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e87643bb-3d7f-4d34-9cf7-d7aa60578540 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.159504 Sep 26 18:02:43.601926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 384/734] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:43 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:02:43.874274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:43.875506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:43.881905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.882462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.882815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.883512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:43.883973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:43.884403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:43.945344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:43.952888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7024e540-8b00-4d44-9029-418984882de1 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1277 microversion: 2.1 time: 0.082590 Sep 26 18:02:43.953496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 351/735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:43 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:44.317185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:44.317824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:44.324229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.324702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.325133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.325853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.326303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.326719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.467636 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:44.482529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6ecc0de9-218b-4fd3-a6ba-cfbe857f0c50 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.163234 Sep 26 18:02:44.482529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 385/736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:44 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:44.482732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:44.482732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:44.482732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:44.487665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.488156 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.488597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.489498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.489958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.490398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.620480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:44.626617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:44.627221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:44.628131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-926ebaec-b9b0-4200-b6ec-5d31c7a22ad6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.152309 Sep 26 18:02:44.628861 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 352/737] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:44 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:44.633037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.633544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.633974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.634651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.635097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.635513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.761105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:44.769641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:44.771075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:44.772220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bf923322-0dc4-47ba-9079-1bb14af44dee tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.149506 Sep 26 18:02:44.772895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 386/738] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:44 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:02:44.975078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:44.975700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:44.982038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.982519 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.982961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:44.983655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:44.984113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:44.984540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.047373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.054919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-25dc6721-1e44-4441-a081-f5dcf857ac55 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1277 microversion: 2.1 time: 0.083672 Sep 26 18:02:45.055489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 353/739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:44 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:45.501638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:45.502245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:45.504445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:45.510836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.512160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.512592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.513306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.513792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.514213 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.651278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:45.652595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:45.659125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.661005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.665954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.666149 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.666314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.666314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.666314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.682912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a981418e-3f0d-4e73-a4f6-a921712b782a tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.185790 Sep 26 18:02:45.684082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 387/740] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:45 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:45.793325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.798972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:45.799689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:45.801652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4dd76166-7aca-4d73-8d70-7d5cd037f1de tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.154252 Sep 26 18:02:45.802229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 354/741] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:45 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:45.805915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.806399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.806838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.807536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:45.807988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:45.808413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:45.945300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.955049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.963258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:45.963258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-366ce4c5-ca70-4af0-aad4-21723be0c41f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1723 microversion: 2.20 time: 0.164042 Sep 26 18:02:45.963258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 388/742] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:45 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:02:46.079091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:46.079839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:46.088009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.088507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.089098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:46.089877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.090339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.090770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:46.180337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:46.189384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-37d1eb3f-9e2d-4409-8cfb-de22edbd638f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1287 microversion: 2.1 time: 0.114864 Sep 26 18:02:46.189959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 355/743] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:46 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:46.707592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:46.708221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:46.710663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=8 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:46.715647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.716130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.722064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:46.722064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.722064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.722064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:46.824344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:46.824981 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:46.831183 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.831666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.832107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:46.832793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:46.833259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:46.833687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.281197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.290054 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-daa98d1d-5d24-4da5-ada7-d1b2b67abd02 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.586447 Sep 26 18:02:47.290608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 389/744] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:46 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:47.310737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:47.311333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:47.317090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:47.317641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:47.318070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.318761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:47.319203 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:47.319623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.336278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.344687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d0014832-fe4b-4f8c-854d-87ab2a7138bf tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.523659 Sep 26 18:02:47.357403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 356/745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:46 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:47.363109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:47.363718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:47.369631 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:47.370116 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:47.370550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.371359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:47.371817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:47.372242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.405612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.414561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.416010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.417172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9545504b-2f0b-4da7-a4e7-c4fe40451e92 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1655 microversion: 2.20 time: 0.110953 Sep 26 18:02:47.417757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 390/746] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:47 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:47.544332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9689462a-a796-4f06-b20f-00ba7a46cace", "name": "network-vif-deleted", "tag": "9148014a-dff0-4bcc-b428-9b6e3da43150"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:47.554251 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:47.554736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:47.555167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:47.566796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] Creating event network-vif-deleted:9148014a-dff0-4bcc-b428-9b6e3da43150 for instance 9689462a-a796-4f06-b20f-00ba7a46cace on hv-cinder-85931 Sep 26 18:02:47.569482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:47.571841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-84b16ceb-e9f8-493c-8fbe-7124eaac6ca4 req-243ae2b1-1c80-4a3a-9df3-12fa45b36003 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031288 Sep 26 18:02:47.572824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 391/747] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:47.577498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-af479168-b380-47b7-aadc-3b5bd3a2737b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.218743 Sep 26 18:02:47.578058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 357/748] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:47 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:48.319142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:48.319864 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:48.328285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.329022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.329492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.330195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.330639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.331225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.367862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:48.368472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:48.379966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.380461 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.380908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.381638 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.382098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.382517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.559915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.567306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5ede2bb3-4f7b-4a35-adf6-7f5751933b1f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.252264 Sep 26 18:02:48.567895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 392/749] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:48 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:48.574283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:48.575588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:48.584446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.584934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.585177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.585406 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.586107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.586624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.587116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.595662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2fff1008-4ec8-4235-80b8-bc592118470e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.231525 Sep 26 18:02:48.596345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 358/750] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:48 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:48.620327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.620809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.621374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.621824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lazy-loading 'fault' on Instance uuid 9689462a-a796-4f06-b20f-00ba7a46cace {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:48.666264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.676411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a4bada-b31b-4e25-8832-5024623a4632", "tag": "b1c77e14-ef2c-407e-9033-32dc079083ae"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:48.682513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.685200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.691752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dccb8c62-8582-4cf0-a988-5beb5d3a75f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 200 len: 1371 microversion: 2.20 time: 0.117581 Sep 26 18:02:48.691885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.691973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 393/751] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:48 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:48.692050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.692050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.693640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:48.694467 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:48.700642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.701131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.701626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.702327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:48.702788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:48.703267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:48.703941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] Creating event network-changed:b1c77e14-ef2c-407e-9033-32dc079083ae for instance a9a4bada-b31b-4e25-8832-5024623a4632 on hv-cinder-85931 Sep 26 18:02:48.709514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-c6922920-9319-4b62-88c5-ecc02cb46c72 req-f0fadab8-8d61-429f-969f-c23f6befb35e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111668 Sep 26 18:02:48.710114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 359/752] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:48.839887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:48.848201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1f0aee05-620a-44f3-8323-0e06152f0968 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.159626 Sep 26 18:02:48.848783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 394/753] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:48 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:49.591760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:49.593033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:49.599144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.599627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.600065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.600758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.601212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.601664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.620227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:49.620911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:49.629041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.629743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.630183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.630880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.631455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.631976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.816678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:49.824874 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a5085772-eda7-4881-95c5-0f0b9e958e3d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.237868 Sep 26 18:02:49.825470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 360/754] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:49 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:49.827269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:49.829910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:49.830537 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:49.835105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-859aecf2-4125-4490-bc0c-02ad376f5257 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.219870 Sep 26 18:02:49.835863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 395/755] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:49 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:49.836373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.836855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.837324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.838013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.838656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.839081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.843085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:49.851950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace HTTP/1.1 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:02:49.853575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:02:49.858831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '9689462a-a796-4f06-b20f-00ba7a46cace'} Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:02:49.860335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:02:49.861873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:02:49.863142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:02:49.863142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f87b3d9f-1de6-4b70-9594-4bfda4040b58 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 404 len: 111 microversion: 2.20 time: 0.028582 Sep 26 18:02:49.863142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 361/756] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:49 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:02:49.865155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b2b86d29-a8a0-4594-a669-1cb4b027c511 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '.version_select at 0x7ff981e4b670>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:49.871799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:49.872416 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:49.877854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:49.879205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.879687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.880122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.880813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:49.881274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:49.881695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:49.978684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b2b86d29-a8a0-4594-a669-1cb4b027c511 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056424971" status: 204 len: 0 microversion: 2.20 time: 0.117224 Sep 26 18:02:49.979218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 396/757] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Sep 26 18:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056424971 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 26 18:02:50.015187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:50.023229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1ebef5d4-810d-4075-9c92-3870731c9353 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.155775 Sep 26 18:02:50.023824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 362/758] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:49 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:50.803667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-08246b29-bea5-4071-9f73-a9ce886e5233 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: .version_select at 0x7ff981c35a60>, body: {"keypair": {"name": "tempest-keypair-933359251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZs1WjL5bEywtgkecmEUBqDXuSqg6j6A22XhF4tnMivwGSCdt0AKEXGoD0e9R1CPE6bE7WGV1RaiDBYH809GbWx4JF5KBNM158NqvYxjxLhmVjqbMH/mj2me8cnFe8G6w=="}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:50.820377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-08246b29-bea5-4071-9f73-a9ce886e5233 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for project 641b37d85a344b1791fcdff859318e42. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:02:50.824225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-08246b29-bea5-4071-9f73-a9ce886e5233 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for user e18ae5c3b0d54666afc4b308831edf04 and project 641b37d85a344b1791fcdff859318e42. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:02:50.848072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:50.848732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:50.850650 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:50.851828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=14 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:50.856858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:50.857390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:50.857836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:50.858568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:50.859031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:50.859481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:50.910257 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-08246b29-bea5-4071-9f73-a9ce886e5233 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.111017 Sep 26 18:02:50.910866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 397/759] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 18:02:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 26 18:02:50.910866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:50.916212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:50.922258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:50.922741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:50.923179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:50.923873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:50.924405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:50.924827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:51.069350 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:51.078853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-725ccb78-e3fe-4b3e-b329-11178de695de tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.233950 Sep 26 18:02:51.079458 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 363/760] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:50 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:51.084322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:51.084933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:51.091110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:51.091882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:51.092489 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:51.093384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:51.093990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:51.094589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:51.112741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:51.120016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-47fc5a21-796f-4b85-ab16-f062c87a9a1c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.208083 Sep 26 18:02:51.120589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 398/761] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:50 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:51.225111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:51.233155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fb4cf158-8657-4f59-902c-b154b5841d9b tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.152523 Sep 26 18:02:51.234109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 364/762] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:51 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:51.774601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921f12a9-6f62-478f-a547-9a46350096ae", "name": "network-vif-plugged", "status": "completed", "tag": "f5160b1d-20ef-4a96-9b5a-cc5148bd71f9"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:51.784694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:51.785167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:51.785627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:51.796330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] Creating event network-vif-plugged:f5160b1d-20ef-4a96-9b5a-cc5148bd71f9 for instance 921f12a9-6f62-478f-a547-9a46350096ae on hv-cinder-85931 Sep 26 18:02:51.801116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-3752526f-7ed7-43d9-ba01-41348a4115c0 req-3aa2d42e-a6fa-438c-ba4c-4dd50b8d34d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030114 Sep 26 18:02:51.801730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 399/763] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:52.102591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:52.104077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:52.110667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.111762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.111762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.112376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.112840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.113418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.144415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:52.145124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:52.151662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.152688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.153312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.154258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.154719 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.155366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.314439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:52.322873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-01a5ae73-215e-4212-8e94-38148e83154b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.224354 Sep 26 18:02:52.323452 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 365/764] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:52 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:52.327887 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:52.328575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:52.334201 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.334687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.335125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.335818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:52.336278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:52.336706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:52.340445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:52.349415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fb4c6575-f1da-4d65-b557-2604bc6f24da tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.209868 Sep 26 18:02:52.350190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 400/765] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:52 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:52.487728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:52.495600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dace1a8a-bfc8-4592-a55e-6426280ad902 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.171172 Sep 26 18:02:52.496363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 366/766] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:52 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:53.331586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-699084473", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e6512-8e6a-49d8-93c1-8bd9f672b2d7"}], "security_groups": [{"name": "tempest-securitygroup--1996420532"}], "key_name": "tempest-keypair-933359251", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:53.347338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:53.347970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:53.354559 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.355053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.355488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:53.356184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.356637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.357064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:53.494613 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] validate_networks() for [('ab7e6512-8e6a-49d8-93c1-8bd9f672b2d7', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:02:53.590760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:53.600332 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eb6e24f7-ef91-4468-b334-c8380a9857c7 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.257215 Sep 26 18:02:53.601053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 367/767] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:53 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:53.606112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:53.607007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:53.613254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.613999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.614661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:53.615584 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.616251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.616872 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:53.839820 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:53.847431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f5a7c9a4-c359-447e-ac57-0ae60b99c46f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1366 microversion: 2.1 time: 0.245146 Sep 26 18:02:53.847992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 368/768] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:53 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:53.852421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:53.853023 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:53.858895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.859468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.859903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:53.860596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:53.861432 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:53.861559 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.020866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:02:54.021608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:02:54.022072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:02:54.022489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:02:54.022903 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:02:54.032299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.032780 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.033243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.033991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.034443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.034870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.051806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for project 641b37d85a344b1791fcdff859318e42. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:02:54.056088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:54.056239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Getting quotas for user e18ae5c3b0d54666afc4b308831edf04 and project 641b37d85a344b1791fcdff859318e42. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:02:54.060330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c30bed46-b241-49f8-bfcd-6fda1cf88168 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.211363 Sep 26 18:02:54.061047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 369/769] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:53 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:54.067823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:02:54.070307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:02:54.261161 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5af26dda-154a-4ba1-a890-4240602b93a6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.933647 Sep 26 18:02:54.262391 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 401/770] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 18:02:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 18:02:54.273398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:54.274160 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:54.333422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:54.341135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:54.342924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:54.344477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d40ae344-b4db-4ce5-a42e-158cd759623b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1280 microversion: 2.20 time: 0.074975 Sep 26 18:02:54.357609 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 370/771] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:54 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:54.625011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:54.625652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:54.632870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.633412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.633846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.634532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.634986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.635408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.780324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:54.784551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:54.789676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-92397554-8c1a-4798-a14b-80284c07245b tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.168599 Sep 26 18:02:54.790242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 402/772] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:54 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:54.871342 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:54.871973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:54.879420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.879914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.880363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:54.881061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:54.881572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:54.882006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.012268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:55.020563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f95cdfd5-d622-4bfd-bf8d-dc8a322735e6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1555 microversion: 2.1 time: 0.153386 Sep 26 18:02:55.021134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 371/773] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:54 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:55.043946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:55.044435 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:55.050319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.050795 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.051227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.051907 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.052354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.052770 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.084422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:55.085032 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:55.091128 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.091574 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.092007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.092706 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.093153 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.093605 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.129532 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a377a85a-b50e-4fd1-86cb-5885bb14788e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089386 Sep 26 18:02:55.131503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 403/774] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:02:55 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:55.233757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:55.241682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a5916dfe-15ff-475b-a9a2-a7b5c2e35db3 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.160905 Sep 26 18:02:55.242346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 372/775] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:55 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:55.371335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:55.371971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:55.379074 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.379487 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.379916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.380655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.381298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.381724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.449582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:55.458374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:55.459851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:55.461017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a565b659-915e-4874-9029-05511829e055 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1284 microversion: 2.20 time: 0.094120 Sep 26 18:02:55.462441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 404/776] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:55 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:55.773807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a4bada-b31b-4e25-8832-5024623a4632", "name": "network-vif-plugged", "status": "completed", "tag": "b1c77e14-ef2c-407e-9033-32dc079083ae"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:55.785493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.786138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.786661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.797936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] Creating event network-vif-plugged:b1c77e14-ef2c-407e-9033-32dc079083ae for instance a9a4bada-b31b-4e25-8832-5024623a4632 on hv-cinder-85931 Sep 26 18:02:55.803588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-90c2e945-537e-4c89-94c6-f71fd9ab4908 req-98757d3d-490d-4b97-9396-f11fa1626ede service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Sep 26 18:02:55.804582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 373/777] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:55.815752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:55.822132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:55.829904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.830396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.830834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.831664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:55.832118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:55.832540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:55.991419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:56.000503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2fca4f58-63c8-46a6-8832-c92d124008c5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1755 microversion: 2.1 time: 0.190932 Sep 26 18:02:56.001084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 405/778] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:55 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:56.195697 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921f12a9-6f62-478f-a547-9a46350096ae", "tag": "f5160b1d-20ef-4a96-9b5a-cc5148bd71f9"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:02:56.208460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:56.209103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:56.209705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:56.225930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] Creating event network-changed:f5160b1d-20ef-4a96-9b5a-cc5148bd71f9 for instance 921f12a9-6f62-478f-a547-9a46350096ae on hv-cinder-85931 Sep 26 18:02:56.231546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-00e6b3c6-9fad-4851-8a8d-017d5b013301 req-42d3c445-d263-4181-b25f-d785a55f0737 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042991 Sep 26 18:02:56.232182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 374/779] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:56.265342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:56.266144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:56.272735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:56.273244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:56.273692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:56.274393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:56.274863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:56.275280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:56.488223 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:56.501324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:56.507765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:56.508262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:56.508704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:56.509451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:56.509919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:56.513886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:56.594303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:56.603605 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:56.605069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:56.607051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-df031bb6-4fb3-46cc-8cd6-627dc7f45ff7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1332 microversion: 2.20 time: 0.123344 Sep 26 18:02:56.607810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 375/780] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:56 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:56.658851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:56.667290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e266854b-a1e2-40bb-9dc9-03e75f2b504a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.406334 Sep 26 18:02:56.667972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 406/781] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:56 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:57.024380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:57.024994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:57.031373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.031866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.032303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.033009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.033490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.033920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.187232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:57.196647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-19b8494c-deb4-4e48-a4e9-a78d5cad5e36 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1758 microversion: 2.1 time: 0.176042 Sep 26 18:02:57.202085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 376/782] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:57 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:57.632155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:57.632767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:57.638690 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.639176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.639635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.640310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.640765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.641198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.690245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:57.690868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:57.696852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.697374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.697821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.698603 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:57.699067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:57.699503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:57.702355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:57.710575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:57.712019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:57.713108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-35c375e9-02ec-4201-9fa0-5e8b110e6d43 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1332 microversion: 2.20 time: 0.085034 Sep 26 18:02:57.713687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 407/783] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:57 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:57.828210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:57.835736 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9c9a2dc3-7f1c-4028-ada0-53d3cde42ece tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.149419 Sep 26 18:02:57.836303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 377/784] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:57 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:58.171390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:58.171905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:58.182237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.182731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.183258 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.183939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.184399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.184829 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.269037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'services' on Instance uuid 26523d3d-340f-4fcc-8594-b8033312e8b2 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:02:58.462821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b3137c97-c52e-4b7d-a2af-3b9cc805e8c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments/1a5fc7c7-ff41-46cf-94a3-aba081618168" status: 202 len: 0 microversion: 2.1 time: 0.295077 Sep 26 18:02:58.463393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 408/785] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:02:58 2022] DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments/1a5fc7c7-ff41-46cf-94a3-aba081618168 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:02:58.472178 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:58.474639 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:58.481197 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.481722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.482168 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.482886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.483387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.483852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.513900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-85d9ee41-9a0b-49b2-815c-789cce825063 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Sep 26 18:02:58.514473 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 378/786] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:58 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:02:58.740439 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:58.741152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:58.747515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.748007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.748440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.749141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.749618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.750039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.820160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:58.828034 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:58.829498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:58.830589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-45fdc3eb-773e-4254-a911-7c351abfb6e6 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1332 microversion: 2.20 time: 0.095509 Sep 26 18:02:58.831310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 409/787] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:58 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:58.858984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:58.859635 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:58.866229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.866721 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.867193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:58.867890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:58.868381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:58.868816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.007894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:59.016240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4189aabd-770e-4041-b6d2-9ad4f2f4076a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1317 microversion: 2.1 time: 0.161037 Sep 26 18:02:59.016819 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 379/788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:58 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:02:59.181667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:59.183926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:59.190462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.190955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.198281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.198281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.198281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.198281 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.221733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-339c7187-40f3-403b-aa77-83893d4d98bd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043943 Sep 26 18:02:59.222710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 410/789] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:59 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:02:59.285349 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:59.291944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:59.291944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.292209 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.292646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.293387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.293849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.294278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.319122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:02:59.321919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=100 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:59.527857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:59.530292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:59.536687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.537180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.537640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.538396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.538856 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.539277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.570173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cdc2ab55-b63f-4177-8133-5de526b64816 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Sep 26 18:02:59.571087 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 411/790] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:02:59 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:02:59.601245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a7b1ed8e-c526-475b-9636-43fd72b14a48 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 204 len: 0 microversion: 2.1 time: 0.319910 Sep 26 18:02:59.601841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 380/791] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:02:59 2022] DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:02:59.610086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:59.610801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:59.616700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.617191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.617739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.618441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.618901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.619330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.752617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:59.761048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-66a6e775-8944-4443-8f12-84b132eda5ba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1671 microversion: 2.1 time: 0.154856 Sep 26 18:02:59.761651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 412/792] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:02:59 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:02:59.855482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:02:59.856136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:02:59.862046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.862536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.862984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.863753 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:59.864213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:59.864644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:59.926319 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:59.934331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:59.935989 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:02:59.937134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cac6b1a7-a39b-46d4-8202-2d9a8d525315 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1340 microversion: 2.20 time: 0.086056 Sep 26 18:02:59.937791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 381/793] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:02:59 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:00.038685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:00.039290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:00.045404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.045892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.046333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.047025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.047483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.047941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.179930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:00.187601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ccc77f58-7c8d-4f7b-b834-5d255b306960 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1506 microversion: 2.1 time: 0.152855 Sep 26 18:03:00.188163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 413/794] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:00 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:00.210401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86290e2d-9922-42a1-9209-e115e3c7d14d", "device": "/dev/sdb"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:00.212936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:00.218929 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.219415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.219856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.220546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.221000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.221457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.583090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:00.585409 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:00.591576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.592106 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.592545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.593249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.593710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.594137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.624132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0ed811e5-7238-4d62-bb03-537f85b95070 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Sep 26 18:03:00.624689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 414/795] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:00 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:00.784690 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:00.785817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:00.792024 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.792500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.792929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.793640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.794091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.794512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.919429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:00.926960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1d5bbc19-7e36-4799-a7be-e1838546b418 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1671 microversion: 2.1 time: 0.146149 Sep 26 18:03:00.927516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 415/796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:00 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:00.963102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:00.963707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:00.969658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.970143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.970577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:00.971367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:00.971825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:00.972251 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:01.033756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:01.043964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:01.044590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:01.045760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7eae549a-86b9-4b97-ba52-eae0882192d3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1340 microversion: 2.20 time: 0.086511 Sep 26 18:03:01.046314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 416/797] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:00 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:01.636817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:01.639135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:01.645168 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:01.645692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:01.646128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:01.646826 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:01.647282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:01.647712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:01.677924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f17dcec5-4df8-4696-8f08-adda77eb3a13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Sep 26 18:03:01.678489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 417/798] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:01 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:01.950179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:01.950807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:01.957241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:01.957737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:01.958175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:01.958869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:01.959329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:01.959763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:02.090690 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:02.098912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-97c036e1-6263-41a4-b3dc-02f98747d6d9 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1671 microversion: 2.1 time: 0.152620 Sep 26 18:03:02.099472 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 418/799] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:01 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:02.103966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:02.104574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:02.109991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:02.110473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:02.110909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:02.111591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:02.112047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:02.112473 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:02.116999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:02.173458 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:02.182078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:02.183518 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:02.184612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6b6661d3-6183-4fe6-b7a9-45b6bdded4ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1340 microversion: 2.20 time: 0.084176 Sep 26 18:03:02.185158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 419/800] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:02 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:02.690535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:02.693186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:02.699546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:02.700003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:02.700431 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:02.701117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:02.701594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:02.702016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:02.731748 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4a3ee9c9-9784-497f-b339-c46fd34defc6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Sep 26 18:03:02.732288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 420/801] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:02 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:03.125564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:03.126951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:03.135055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.135537 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.136142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.136840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.137496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.137981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.331998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:03.341283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-249c4208-576c-48d7-bd28-1050d3697bf3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1671 microversion: 2.1 time: 0.222276 Sep 26 18:03:03.342632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 421/802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:03 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:03.347585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:03.349289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:03.358333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.358834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.359331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.360099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.360556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.360983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.424382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:03.434608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:03.436189 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:03.437374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-76056324-dc9d-4dde-81f1-cda9b790f810 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1338 microversion: 2.20 time: 0.093503 Sep 26 18:03:03.437960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 422/803] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:03 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:03.629696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fbfe64fb-2e56-475d-a870-299e5a2bda70 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "POST /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.422201 Sep 26 18:03:03.630559 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 382/804] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:03:00 2022] POST /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632/os-volume_attachments => generated 194 bytes in 3425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:03.745289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:03.747025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:03.753541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.754734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.755537 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.756715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:03.757602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:03.758197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:03.794384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-329fae30-fa78-4cd6-adb1-7a3f0a0e4a51 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053899 Sep 26 18:03:03.795586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 423/805] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:03 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:04.366290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:04.367380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:04.374435 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:04.376468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.376712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.377388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.378107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.378562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.379715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.467988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:04.468602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:04.471673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:04.472776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=10 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:04.485756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.486271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.488974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.490044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.494292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:04.498965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.500960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.502501 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f5914cf4-03d7-4d36-af7f-c9379cca26a7 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1603 microversion: 2.1 time: 0.140509 Sep 26 18:03:04.522898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 383/806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:04 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1603 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:04.530298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b533dfe6-6158-43f2-961d-f50d398f79d6", "name": "network-vif-deleted", "tag": "35e30149-7490-417a-a493-6bef261bb382"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:04.547041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.547960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.548727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.563496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] Creating event network-vif-deleted:35e30149-7490-417a-a493-6bef261bb382 for instance b533dfe6-6158-43f2-961d-f50d398f79d6 on hv-cinder-85931 Sep 26 18:03:04.569667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-f7b4cfe1-a4b7-47d7-bdd1-ffd6703df2c5 req-f175d8b9-a2c3-41be-b6de-ae753be5fe7e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045214 Sep 26 18:03:04.570275 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 384/807] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:04.804516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:04.805892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:04.807612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:04.808984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-727a841a-d755-4b5e-a06e-402ef5d54df7 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.344926 Sep 26 18:03:04.811409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:04.814282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:04.821727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.822189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.822632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.823348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.823810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.824235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.827980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 424/808] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:04 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:04.854588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c30ea574-edb4-47c0-bca7-298eb4060192 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050380 Sep 26 18:03:04.855268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 385/809] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:04 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:03:04.955757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:04.956321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:04.963883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.964476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.965000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.965802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:04.966324 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:04.966827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:04.995620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:03:05.529774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:05.530396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:05.537470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.537983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.538438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.539138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.539590 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.540011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.572667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.573147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.573616 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.574056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:05.648145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:05.654648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-443259f7-def6-4919-831e-0be43d81d308 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1325 microversion: 2.1 time: 0.128830 Sep 26 18:03:05.655670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 386/810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:05 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:05.671837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-23a94ce2-af86-4282-9090-ebc8fa5ac62f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 204 len: 0 microversion: 2.1 time: 0.720523 Sep 26 18:03:05.672285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 425/811] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:03:04 2022] DELETE /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:03:05.682221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:05.685757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:05.692743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.693374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.693816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.694565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.695190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.695813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.732992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:05.746769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.747380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.748212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.760482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] Creating event network-changed:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:03:05.765478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-8442deaf-4800-4ff7-a975-9cfde8d4d382 req-cc179e77-8cb1-48c6-93d1-b5db3ba6f655 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108340 Sep 26 18:03:05.766522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 387/812] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:05.836231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:05.846358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:05.846358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.846358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.846358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.847926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:05.847926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:05.847926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:05.860868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:05.870369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1beb2f81-2e3b-49ce-a80d-b21d3a397815 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.192662 Sep 26 18:03:05.870953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 426/813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:05 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:05.978772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:05.986840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:05.988935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:05.990073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a9b33913-4238-45b3-929c-5ddedb84c837 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.159211 Sep 26 18:03:05.990633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 388/814] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:05 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:06.679850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:06.680458 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:06.686905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:06.687384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:06.687840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:06.688553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:06.689003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:06.689457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:06.722096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:06.722933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:06.723367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:06.723804 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:06.763224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:06.771394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-66cd9125-c950-4702-93df-ae18f2b4471c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1325 microversion: 2.1 time: 0.095381 Sep 26 18:03:06.771958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 427/815] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:06 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:06.894308 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:06.894956 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:06.901484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:06.902226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:06.902666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:06.903360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:06.903817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:06.904247 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.015000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:07.015613 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:07.021546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:07.022032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:07.022468 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.023159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:07.023615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:07.024043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.032522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:07.040306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4f37aa68-2408-45ca-86fa-6d2c4454d804 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.149829 Sep 26 18:03:07.040963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 389/816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:06 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:07.148565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:07.156816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:07.158318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:07.159424 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e7c4c013-e5ea-4199-a193-67babdb963c5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.148369 Sep 26 18:03:07.160480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 428/817] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:07 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:07.794358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:07.794974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:07.800914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:07.801441 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:07.801883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.802578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:07.803036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:07.803474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.833884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:07.834296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:07.834754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:07.835194 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:07.875079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:07.882587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7956da50-29e3-424d-9cf8-cc94586b076b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1325 microversion: 2.1 time: 0.092088 Sep 26 18:03:07.883145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 390/818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:07 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:08.064302 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:08.064919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:08.067913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:08.072521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.073025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.073465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.101973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.101973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.101973 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.185401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:08.186154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:08.193440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.194010 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.194522 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.195292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.195827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.196354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.207786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:08.216174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-42470f37-9c9a-4370-825e-00d6a1aeeccb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.155802 Sep 26 18:03:08.216744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 429/819] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:08 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:08.324958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:08.335107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:08.335107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:08.335463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f8fb0156-1573-4fba-8fc9-0d046b5e958e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.153995 Sep 26 18:03:08.336016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 391/820] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:08 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:08.907584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:08.908123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:08.914470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.914952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.915388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.916075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.916525 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.916950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.947042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:08.947518 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:08.947956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:08.948397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:08.990876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:08.998401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-813b56e9-309b-4d34-98e4-7c60075aa73a tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1325 microversion: 2.1 time: 0.095215 Sep 26 18:03:08.998974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 430/821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:08 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:09.239117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:09.239738 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:09.246526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:09.247015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:09.247449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:09.248136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:09.248599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:09.249024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:09.360011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:09.360640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:09.367308 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:09.367789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:09.368222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:09.369426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:09.369426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:09.369807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:09.378777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:09.386932 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9a2ac007-d57a-4dcd-b8bd-1ad672932bfb tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.151700 Sep 26 18:03:09.387487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 392/822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:09 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:09.497131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:09.506130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:09.507629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:09.508731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-732d9436-f789-4c39-91ff-f55ef36e792d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.152690 Sep 26 18:03:09.509312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 431/823] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:09 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:10.021120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:10.021757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:10.027938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.028421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.028852 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.029560 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.030138 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.030431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.060282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.060780 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.061202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.061665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid b533dfe6-6158-43f2-961d-f50d398f79d6 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:10.101963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:10.109676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3c059c77-7f42-44e7-9103-a67bfb5b0b06 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 200 len: 1325 microversion: 2.1 time: 0.092511 Sep 26 18:03:10.110235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 393/824] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:10 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:10.411777 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:10.412417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:10.419012 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.419500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.419941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.420686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.421139 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.421594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.533842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:10.534479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:10.541623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.542111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.542552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.543250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:10.543707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:10.544135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:10.551241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:10.559178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fa481313-c1ab-4ca7-bec8-6a4a353a90ae tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.151862 Sep 26 18:03:10.570619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 432/825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:10 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:10.676731 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:10.679039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:10.685666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:10.687867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:10.688438 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-46a04495-e433-423d-a0b1-0655a5752342 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.158392 Sep 26 18:03:10.689033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 394/826] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:10 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:11.141718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:11.141718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:11.148819 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.152378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.152378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.152378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.152378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.152915 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.173563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 HTTP/1.1 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:03:11.174870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:03:11.176485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'b533dfe6-6158-43f2-961d-f50d398f79d6'} Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:11.177370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:03:11.178600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.179696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:11.179696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9d76d3cd-126a-43dd-8a5d-cc4a32520134 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 404 len: 111 microversion: 2.1 time: 0.047168 Sep 26 18:03:11.180501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 433/827] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:11 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:03:11.185345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bd33f1ca-c441-47bf-b6be-1c40ca956fb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '.version_select at 0x7ff981cf5dc0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:11.193755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.263375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bd33f1ca-c441-47bf-b6be-1c40ca956fb3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86825364" status: 202 len: 0 microversion: 2.1 time: 0.081788 Sep 26 18:03:11.263943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 395/828] 10.222.0.49 () {58 vars in 1215 bytes} [Mon Sep 26 18:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86825364 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:03:11.583616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:11.584173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:11.590517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.593098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.593098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.593098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.593098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.593495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.597341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.715505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:11.716679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:11.725214 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.725991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.726429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.727124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:11.727572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:11.727994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:11.856164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:11.866053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-afb74246-085a-4c10-bc9f-cbfec6493373 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1690 microversion: 2.1 time: 0.287487 Sep 26 18:03:11.866660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 434/829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:11 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1690 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:11.900114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:11.908415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:11.909900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:11.911547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-24f35a2c-47af-4b01-91fa-e61250267647 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.201605 Sep 26 18:03:11.914437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 396/830] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:11 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:12.361561 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-69566f71-bc86-414c-b507-340557a2e572 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: .version_select at 0x7ff981dae9d0>, body: {"keypair": {"name": "tempest-keypair-351733989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPIcOmj4Pexq2z275+cqsmiad7F0HPxF0TSV6rQKrqMBeVqAv5hUo6BrZVrjGV27vgOSRG6Odn+O/JJNU12cmSLudF8FzzmSNz1OSy/FTEuANEpaF4vcIZdkoooIzU2iw=="}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:12.376945 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-69566f71-bc86-414c-b507-340557a2e572 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:12.381121 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-69566f71-bc86-414c-b507-340557a2e572 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for user 2020860051d44960a924b62989a7988b and project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'key_pairs'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:12.505833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-69566f71-bc86-414c-b507-340557a2e572 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142311 Sep 26 18:03:12.505833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 435/831] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:03:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:12.740558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26523d3d-340f-4fcc-8594-b8033312e8b2", "name": "network-vif-deleted", "tag": "e743a8e1-7765-411d-bc49-935d2ee87513"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:12.750567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:12.751116 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:12.751551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:12.763511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] Creating event network-vif-deleted:e743a8e1-7765-411d-bc49-935d2ee87513 for instance 26523d3d-340f-4fcc-8594-b8033312e8b2 on hv-cinder-85931 Sep 26 18:03:12.768394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-b9ca28c7-aa9d-40a6-83ae-99907e82dcb4 req-c4bac625-bf2d-4817-9c34-7c1d81ae3b58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032038 Sep 26 18:03:12.768984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 397/832] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:12.890723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:12.891549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:12.913104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:12.913642 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:12.914074 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:12.914786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:12.915238 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:12.915659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:12.942105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:12.944185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:12.952144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:12.953016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:12.953796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:12.955121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:12.955758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:12.956364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:12.999063 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:13.010674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-19d6c121-2116-493b-8695-fc106aed1729 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1622 microversion: 2.1 time: 0.124725 Sep 26 18:03:13.011266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 436/833] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:12 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1622 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:13.133824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:13.142460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:13.143850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:13.145033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-278db10e-2388-4ac4-8ac7-2ad985174dfa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.209691 Sep 26 18:03:13.145611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 398/834] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:12 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:14.035083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:14.035706 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:14.042640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:14.043120 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:14.043554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:14.044239 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:14.044692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:14.045117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:14.108162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:14.117210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0ab8250b-7c1f-43a6-b14d-aa2476b631a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1622 microversion: 2.1 time: 0.086003 Sep 26 18:03:14.117824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 437/835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:14 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:14.171263 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:14.171905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:14.180200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:14.180705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:14.181147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:14.181877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:14.182377 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:14.182813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:14.314913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:14.323393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:14.324844 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:14.326006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ec1e6dc2-2bff-4622-9834-5ed8062ac896 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.158988 Sep 26 18:03:14.326569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 399/836] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:14 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:14.621779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1652404298", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7327a67e-44b9-426d-af9d-05e96c87ac54"}], "security_groups": [{"name": "tempest-securitygroup--712439776"}], "key_name": "tempest-keypair-351733989", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:14.724446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] validate_networks() for [('7327a67e-44b9-426d-af9d-05e96c87ac54', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:03:15.078186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:03:15.078793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:03:15.079132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:03:15.079551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:03:15.079965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:03:15.092964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.092964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.092964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.092964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.093483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.093483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.108934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:15.112987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Getting quotas for user 2020860051d44960a924b62989a7988b and project b04dd3fdb6ab4fddbd9f68b60cac3568. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:15.124162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:03:15.126496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:03:15.141146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:15.141815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:15.148314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.148798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.149245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.149939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.150386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.150827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.212256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:15.219871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a3258c5b-04ab-4c67-9e67-a4e2bb0b40dc tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1622 microversion: 2.1 time: 0.082470 Sep 26 18:03:15.221431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 400/837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:15 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1622 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:15.282540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f1b600a8-7b50-41f3-a3b0-dc8d5731cea0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665008 Sep 26 18:03:15.283090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 438/838] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:03:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:03:15.295103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-094493e0-47e5-4c51-9aab-329871c6c4e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:15.295711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-094493e0-47e5-4c51-9aab-329871c6c4e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:15.352033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-094493e0-47e5-4c51-9aab-329871c6c4e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:15.355720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:15.356345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:15.359701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-094493e0-47e5-4c51-9aab-329871c6c4e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1237 microversion: 2.1 time: 0.068367 Sep 26 18:03:15.360395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 401/839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:15 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:15.363122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.363607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.364240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.364994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:15.365483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:15.366048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:15.497758 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:15.506095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:15.507547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:15.508686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-43f13759-2462-4c26-b0ca-44d61b1b758b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.157079 Sep 26 18:03:15.509246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 439/840] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:15 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:16.243922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:16.244552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:16.251064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.251548 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.251985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.252677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.253131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.253591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.316518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:16.327360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6472a902-2f49-46df-997c-e7ca1aeafa67 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1622 microversion: 2.1 time: 0.087282 Sep 26 18:03:16.327935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 402/841] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:16 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:16.385783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:16.387079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:16.395766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.396787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.397691 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.398414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.398876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.399475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.466410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:16.474605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8e437c3c-bb7d-4295-9565-746de7806a0b tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1241 microversion: 2.1 time: 0.095013 Sep 26 18:03:16.476493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 440/842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:16 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:16.534063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:16.534711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:16.541905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.542692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.543246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.544061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:16.544618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:16.545187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:16.705541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:16.714574 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:16.716533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:16.718630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-214baa38-768e-4ee1-b9d5-08bf0a555d88 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.187649 Sep 26 18:03:16.734493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 403/843] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:16 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:17.351881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:17.352500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:17.358984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.359464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.359904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.360596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.361047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.361491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.394538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.395242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.395480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.395967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'fault' on Instance uuid 26523d3d-340f-4fcc-8594-b8033312e8b2 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:17.436998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:17.445420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-39526983-d542-405d-a5a2-dbcfa59a55e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 200 len: 1335 microversion: 2.1 time: 0.097556 Sep 26 18:03:17.445989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 441/844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:17 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:17.497720 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:17.498370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:17.505259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.505782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.506226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.506922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.507382 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.507814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.571812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:17.579663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-de52dcdc-50d7-4e0c-9d22-917697c42fdd tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1233 microversion: 2.1 time: 0.085806 Sep 26 18:03:17.580323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 404/845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:17 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:17.746032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:17.746646 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:17.752834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.753362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.753860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.754592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:17.755052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:17.755493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:17.888327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:17.896723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:17.898200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:17.899346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0cbc467c-b7ac-4578-89f2-c9a3a0f3af42 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.157276 Sep 26 18:03:17.900110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 442/846] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:17 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:18.468892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:18.469533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 26523d3d-340f-4fcc-8594-b8033312e8b2] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:18.475486 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.475972 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.476406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:18.477120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.477667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.478096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:18.491162 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] HTTP exception thrown: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Request method failure captured: Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 HTTP/1.1 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegKNAjit7s3pSDX4eZsJuiExXyG9ODWhNqywnJvUzWbeIhOvLWYNNS1U26Kp05e7c-OIx67D5mGH0cCXXu8YGoJJQoCKGs6H03kBDsZCbgHDoy28bv2GsRi4j0ceA2pjH1qv85HSfImoJQAXxG1kvk6xkXz3ixMAcQZC8x1d-Prmn4 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:03:18.492783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/222cdd96fb334e63a823cab0d33f939f"}]}] Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 0416809c467846428e7df9a7c11ffb0e Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. Sep 26 18:03:18.495565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '26523d3d-340f-4fcc-8594-b8033312e8b2'} Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:18.496316 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. Sep 26 18:03:18.497476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:03:18.499290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Returning 404 to user: Instance 26523d3d-340f-4fcc-8594-b8033312e8b2 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:18.499290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a21e07e6-2cca-4cb1-bc54-2292c5f21495 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2" status: 404 len: 111 microversion: 2.1 time: 0.029213 Sep 26 18:03:18.499290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 405/847] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:18 2022] GET /compute/v2.1/servers/26523d3d-340f-4fcc-8594-b8033312e8b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:18.502755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cbe55696-dfcf-4466-9373-39001b0624c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '.version_select at 0x7ff981adb280>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:18.605429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:18.606085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:18.612364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cbe55696-dfcf-4466-9373-39001b0624c6 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621071442" status: 202 len: 0 microversion: 2.1 time: 0.113405 Sep 26 18:03:18.612857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.612958 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 443/848] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 18:03:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621071442 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:03:18.614569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.614569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:18.614569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.614984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.615418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:18.681430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:18.689150 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eea1adfe-5f1d-49d3-a8a8-176e47b2b803 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1289 microversion: 2.1 time: 0.087817 Sep 26 18:03:18.689897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 406/849] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:18 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:18.925565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:18.926181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:18.932674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.933160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.933631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:18.934321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:18.934771 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:18.935196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:19.142794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:19.150971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:19.152725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:19.153860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0e924072-e5ea-45d6-89ad-bafc34b6afca tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.232316 Sep 26 18:03:19.154423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 444/850] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:18 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:19.713730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:19.714340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:19.721095 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:19.721656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:19.722089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:19.722839 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:19.723900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:19.724353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:19.787398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:19.795434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5d64f08e-83a1-420c-ba18-ed2610afa7e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1289 microversion: 2.1 time: 0.085539 Sep 26 18:03:19.796097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 407/851] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:19 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:20.179599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:20.180208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:20.186601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:20.187079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:20.187539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:20.188221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:20.188663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:20.189082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:20.316794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:20.325538 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:20.326987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:20.328178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-039180ff-7af1-459b-b525-487964284a75 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.152382 Sep 26 18:03:20.328681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 445/852] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:20 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:20.816828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:20.817487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:20.828410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:20.828913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:20.829390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:20.830100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:20.830587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:20.830995 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:20.893624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:20.901321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d11e89f8-180a-49bc-bb0e-0f2514f93158 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1289 microversion: 2.1 time: 0.088304 Sep 26 18:03:20.902144 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 408/853] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:20 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:21.354111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:21.354853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:21.361392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:21.361885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:21.362326 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:21.363137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:21.363594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:21.364025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:21.499404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:21.512354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:21.513878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:21.515143 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f776f128-fe5b-4ebf-ba15-5fcf1927934d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.165031 Sep 26 18:03:21.515713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 446/854] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:21 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:21.925374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:21.925986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:21.933186 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:21.933696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:21.934132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:21.934876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:21.935329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:21.935749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:22.002597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:22.013529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b4cbae28-94a4-4128-a4a3-c7fb22c1b0e2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1307 microversion: 2.1 time: 0.092390 Sep 26 18:03:22.015066 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 409/855] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:21 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:22.541290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:22.542408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:22.548722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:22.549210 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:22.549824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:22.550569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:22.551023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:22.551448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:22.701981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:22.710931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:22.712450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:22.713683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-929e479a-8767-4aa7-a139-18e806ca2d2c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.177513 Sep 26 18:03:22.714321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 447/856] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:22 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:22.916158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:22.925784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:22.926410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:22.926811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:22.938456 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] Creating event network-vif-plugged:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:03:22.944038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-2175d784-cfc5-438a-8938-4d15086b8b96 req-35cfeabc-1a07-4a5e-8f10-6f13207ccb16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086962 Sep 26 18:03:22.944662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 410/857] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:23.036269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:23.036936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:23.043396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.043885 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.044327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.045023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.045514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.047397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.180218 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:23.188130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3abddc57-11d4-461e-94e7-352895d59e0f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.155779 Sep 26 18:03:23.188709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 448/858] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:23 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:23.201439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:23.202033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:23.209035 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.209704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.213864 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.213864 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.213864 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.213864 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.230703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fa9d97-e143-4954-bd53-12a953f8c78b", "tag": "1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:23.238732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:03:23.243859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.244720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.245371 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.260426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] Creating event network-changed:1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7 for instance d8fa9d97-e143-4954-bd53-12a953f8c78b on hv-cinder-85931 Sep 26 18:03:23.265574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-cf84a4ff-eacf-49c7-9f33-43db61375672 req-cfd60971-34e8-41b9-be14-cb505f028433 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038992 Sep 26 18:03:23.266728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 449/859] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:23.617544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c375f6ef-35ad-49e5-ae0d-62280539d6c2 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 204 len: 0 microversion: 2.1 time: 0.420205 Sep 26 18:03:23.618143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 411/860] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:03:23 2022] DELETE /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:03:23.627192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:23.627992 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:23.635417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.635916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.636360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.637067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.637591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.638114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.741037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:23.741865 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:23.747992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.748481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.748918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.749666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:23.750117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:23.750544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:23.891262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:23.899165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b3085758-0140-4661-b7b8-4d3708dd94e4 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1508 microversion: 2.1 time: 0.276722 Sep 26 18:03:23.899734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 450/861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:23 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:23.936849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:23.945189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:23.946685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:23.947793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-de9c9e85-03c2-4e89-ba93-805a35f14299 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.211784 Sep 26 18:03:23.948343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 412/862] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:23 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:03:24.212045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:24.212674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:24.218664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.219142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.219577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.220267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.220720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.221148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.602600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:24.611335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-73431d01-101e-4378-bd77-a2d53515b182 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.403655 Sep 26 18:03:24.611901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 451/863] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:24 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:24.852724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:24.853206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:24.859155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.859637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.860072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.860757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.861212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.861667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.922968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:24.923591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:24.930654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.931307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.932110 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.932825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:24.933310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:24.933817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:24.936658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:24.942133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'services' on Instance uuid a9a4bada-b31b-4e25-8832-5024623a4632 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:25.062080 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:25.070249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-44188690-1b5c-4fa3-b6a2-ba0a637dadb5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1508 microversion: 2.1 time: 0.151285 Sep 26 18:03:25.070819 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 452/864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:24 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:25.082165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:25.082165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:25.082165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:25.082165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:25.082862 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:25.083026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:25.083442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:25.083869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:25.106366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:25.122222 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=10 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:25.225580 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:25.229315 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:25.234039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bad216df-8a57-46b2-a456-ef2ff974814f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632/os-volume_attachments/86290e2d-9922-42a1-9209-e115e3c7d14d" status: 202 len: 0 microversion: 2.1 time: 0.385032 Sep 26 18:03:25.234635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:25.234757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 413/865] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:03:24 2022] DELETE /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632/os-volume_attachments/86290e2d-9922-42a1-9209-e115e3c7d14d => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:03:25.236182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:25.237326 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f1210c32-0700-4daa-91f6-890b9c461c2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.165581 Sep 26 18:03:25.237868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 453/866] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:25 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:25.634892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:25.635630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:25.637622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:25.642816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:25.643304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:25.643779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:25.644511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:25.644978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:25.645439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:25.779750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:25.787893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c3752d3f-6242-475c-bb03-7638bdd09ac4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.157182 Sep 26 18:03:25.788453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 414/867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:25 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:26.104299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:26.104970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:26.112333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.112816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.113270 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.113961 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.115083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.115497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.240334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:26.248022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-48ce5873-3e2f-4a02-80e5-e0e5336752b7 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1508 microversion: 2.1 time: 0.147600 Sep 26 18:03:26.248590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 454/868] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:26 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:26.263069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:26.263682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:26.270095 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.270581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.271529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.272232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.272694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.273149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.403196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:26.411252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:26.413508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:26.414627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b5c808d0-2356-489f-bd3b-3ab16dcebe64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1406 microversion: 2.20 time: 0.155402 Sep 26 18:03:26.415184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 415/869] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:26 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:26.811100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:26.811716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:26.818243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.818735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.819175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.819882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:26.820339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:26.820764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:26.957094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:26.965738 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-844e345b-40ed-4126-a99f-c9616f3d93b0 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.158486 Sep 26 18:03:26.966322 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 455/870] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:26 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:27.271383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:27.277566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:27.281074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.281823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.282470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.283398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.284051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.284692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.369865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b915bd-9baa-4915-861d-b2d2916f390f", "name": "network-vif-deleted", "tag": "1c747281-9d9d-4183-b4f2-a9beb65a911f"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:27.403782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.405207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.406296 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.439826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:27.441321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] Creating event network-vif-deleted:1c747281-9d9d-4183-b4f2-a9beb65a911f for instance 39b915bd-9baa-4915-861d-b2d2916f390f on hv-cinder-85931 Sep 26 18:03:27.451564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0973dde4-7369-47db-8fe1-23246288bb0c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1466 microversion: 2.1 time: 0.183958 Sep 26 18:03:27.452143 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 416/871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:27 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1466 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:27.456550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:27.457153 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:27.465744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-f02e3b11-4d57-43fc-b38f-b231b7e3f18b req-cdd6ffb3-66c3-47ff-aaa0-b2a2e98d8810 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106239 Sep 26 18:03:27.469357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 456/872] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:27.472360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.472859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.478880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.478880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.478880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.478880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.625162 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:27.634106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:27.635601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:27.637128 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-df23462a-42f9-45ce-877e-b34a1fea8158 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1598 microversion: 2.20 time: 0.183865 Sep 26 18:03:27.637910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 417/873] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:03:27 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:03:27.663841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:27.664647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:27.671397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.671971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.672397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.673304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.673721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.674147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.759280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-480e2a23-2af1-4895-b302-36402a98bbb5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100391 Sep 26 18:03:27.759870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 457/874] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 18:03:27 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:03:27.987907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:27.988544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:27.995339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.995838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.996315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:27.997064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:27.997553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:27.998047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.127031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:28.135512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f38db647-2379-432c-8f93-dd07531f4b28 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.151428 Sep 26 18:03:28.136088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 418/875] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:27 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:28.475648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:28.476266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:28.482500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.482994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.483430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.484133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.484593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.485021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.547406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:28.548699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:28.555957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.556735 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.557454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.559231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.559914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.560572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.565497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:28.575651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0c482fd0-c30a-4a6a-bdeb-f25edaf0fc13 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1292 microversion: 2.1 time: 0.104341 Sep 26 18:03:28.576542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 458/876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:28 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:28.593151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:03:28.919897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9f32483c-de94-462d-8762-6663dfcb9f36 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 204 len: 0 microversion: 2.1 time: 0.376165 Sep 26 18:03:28.920619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 419/877] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:03:28 2022] DELETE /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:03:28.929541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:28.930169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:28.936297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.936787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.937249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:28.937960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:28.938421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:28.938854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.074618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:29.094987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-74a2e19a-9f4c-4d45-9697-8829228044a9 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1512 microversion: 2.1 time: 0.168871 Sep 26 18:03:29.094987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 459/878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:28 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:29.159779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:29.160492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:29.168065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.168703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.169145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.169893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.170355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.170789 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.306370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:29.314339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9fd17a7b-0718-4235-9c81-976d9c8ac76f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.158931 Sep 26 18:03:29.314918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 420/879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:29 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:29.480775 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:29.490727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.491202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.491628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.504844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] Creating event network-changed:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:03:29.507919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-3ad41fd8-8a75-4fe5-907a-1eb3504d2123 req-58c0a387-8759-4f5b-956c-10fec2bcf702 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030890 Sep 26 18:03:29.508528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 460/880] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:29.599653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:29.600269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:29.606737 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.607229 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.607672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.608372 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.608831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.609286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.644417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:29.644914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:29.645399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:29.646455 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'fault' on Instance uuid 39b915bd-9baa-4915-861d-b2d2916f390f {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:29.688734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:29.697207 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0eec9376-3604-4fd0-8007-86da50687768 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1311 microversion: 2.1 time: 0.102064 Sep 26 18:03:29.697886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 421/881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:29 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:30.119417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:30.120175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:30.127027 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.127575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.128076 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.128946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.129550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.130759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.268079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:30.276036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d8b34e09-1ab5-47ad-893f-724cbac0952a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1512 microversion: 2.1 time: 0.161761 Sep 26 18:03:30.276861 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 461/882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:30 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:30.337282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:30.337912 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:30.343942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.344436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.344878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.345649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.346113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.346544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.473351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:30.481471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6177689d-c7f8-4ddf-9d53-460fe8c3f4de tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.148108 Sep 26 18:03:30.482047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 422/883] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:30 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:30.722175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:30.722734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:30.729692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.730174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.730608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.731300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.731756 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.732182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.761684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:30.765268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:30.765761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:30.766201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:30.766648 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'fault' on Instance uuid 39b915bd-9baa-4915-861d-b2d2916f390f {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:30.807629 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:30.815343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4985c1bd-cda7-4bcf-8322-58650baf4f62 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1311 microversion: 2.1 time: 0.097160 Sep 26 18:03:30.815920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 462/884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:30 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:31.299259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:31.299920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:31.306527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.307017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.307462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.308162 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.308626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.309060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.474811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:31.482886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dafa5df6-8d5b-4420-882c-911ba57df593 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1512 microversion: 2.1 time: 0.187439 Sep 26 18:03:31.483803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 423/885] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:31 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:31.504479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:31.506356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:31.512351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.512849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.513358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.514067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.514524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.514989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.735640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:31.744699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2924566e-369d-4aa5-bb9f-0c02d67279b3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.244596 Sep 26 18:03:31.759636 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 463/886] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:31 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:31.838293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:31.838946 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:31.845028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.845661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.846167 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.847112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.847582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.848013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.878960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.879451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.879892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.880914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'fault' on Instance uuid 39b915bd-9baa-4915-861d-b2d2916f390f {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:31.921457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:31.929771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f607b285-8e1e-4070-9763-88b05abe3888 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 200 len: 1311 microversion: 2.1 time: 0.095414 Sep 26 18:03:31.930346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 424/887] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:31 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:32.193057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a4bada-b31b-4e25-8832-5024623a4632", "name": "network-vif-deleted", "tag": "b1c77e14-ef2c-407e-9033-32dc079083ae"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:32.203375 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.203932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.204384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.215595 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] Creating event network-vif-deleted:b1c77e14-ef2c-407e-9033-32dc079083ae for instance a9a4bada-b31b-4e25-8832-5024623a4632 on hv-cinder-85931 Sep 26 18:03:32.220359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-b67064cb-b023-4a60-b945-440196debae3 req-ff7b84a9-190e-4ebb-9edf-989365bb9532 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Sep 26 18:03:32.221015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 464/888] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:32.515941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:32.516595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:32.523569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.524059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.524503 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.525244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.525703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.526132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.588333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:32.595916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a1a62ea8-3f29-46a4-be15-73c341505f58 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1302 microversion: 2.1 time: 0.083906 Sep 26 18:03:32.596475 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 425/889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:32 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:32.768521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:32.769468 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:32.776979 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.777513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.777959 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.778664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.779124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.779556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.915752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:32.924632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fab78b8a-87d4-46f8-a0a9-3542de6a923d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.160682 Sep 26 18:03:32.933868 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 465/890] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:32 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:32.939370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9d97-e143-4954-bd53-12a953f8c78b", "name": "network-vif-plugged", "status": "completed", "tag": "1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:32.951398 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.952039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.952721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:32.952870 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.953402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: 39b915bd-9baa-4915-861d-b2d2916f390f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:32.960188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.960683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.961126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.961878 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.962358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.962755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.966056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] Creating event network-vif-plugged:1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7 for instance d8fa9d97-e143-4954-bd53-12a953f8c78b on hv-cinder-85931 Sep 26 18:03:32.971342 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-95cbbadf-5f7c-4d50-9739-b39fc18ab98a req-767740e6-9428-4868-98c9-283f9f55d0eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035417 Sep 26 18:03:32.972192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 426/891] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:32.979378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] HTTP exception thrown: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Request method failure captured: Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f HTTP/1.1 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKNAjit7s3pSDX4eZsJuiExXyG9ODWhNqywnJvUzWbeIhOvLWYNNS1U26Kp05e7c-OIx67D5mGH0cCXXu8YGoJJQoCKGs6H03kBDsZCbgHDoy28bv2GsRi4j0ceA2pjH1qv85HSfImoJQAXxG1kvk6xkXz3ixMAcQZC8x1d-Prmn4 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:03:32.981172 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/222cdd96fb334e63a823cab0d33f939f"}]}] Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0416809c467846428e7df9a7c11ffb0e Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. Sep 26 18:03:32.982667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '39b915bd-9baa-4915-861d-b2d2916f390f'} Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:32.983569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. Sep 26 18:03:32.984914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:32.986068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Returning 404 to user: Instance 39b915bd-9baa-4915-861d-b2d2916f390f could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:32.986068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7e7b7c43-5dbb-4091-9693-d72530742d9c tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f" status: 404 len: 111 microversion: 2.1 time: 0.033948 Sep 26 18:03:32.986068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 466/892] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:32 2022] GET /compute/v2.1/servers/39b915bd-9baa-4915-861d-b2d2916f390f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:03:32.996019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:32.996019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.001601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.002205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.002725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.003515 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.004284 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.005986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.036278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:03:33.050504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:33.347948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7f8ae9e1-f59b-4903-9ef8-930365d9aae0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 204 len: 0 microversion: 2.1 time: 0.360064 Sep 26 18:03:33.348538 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 427/893] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:03:32 2022] DELETE /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:03:33.356608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:33.357240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.363215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.363705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.364142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.365401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.365858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.366286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.504272 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:33.514068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4eed6c3b-aa65-4ad7-babf-473c3019b94f tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.160465 Sep 26 18:03:33.514341 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 467/894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:33 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:33.622273 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:33.622898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.629568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.630054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.630494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.631226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.631688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.632115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.815812 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.816295 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.816742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.817476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'fault' on Instance uuid a9a4bada-b31b-4e25-8832-5024623a4632 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:33.858234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:33.865823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fd185b7c-ebd3-4d88-8586-f7ccd92a4c4f tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1307 microversion: 2.1 time: 0.248278 Sep 26 18:03:33.866389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 428/895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:33 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:33.947667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:33.948289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.954865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.955349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.955788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.956478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.956982 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.957442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.083509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:34.091089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d71f7cb9-04d2-460e-9938-f32904db30d8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.147421 Sep 26 18:03:34.091651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 468/896] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:33 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:34.536924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:34.537618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:34.543429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.543905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.544340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.545017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.545492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.545931 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.676502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:34.684530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a0a9b51c-d78a-4e75-b6f3-2b4de4c0dc83 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.151443 Sep 26 18:03:34.685078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 429/897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:34 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:34.887967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:34.888591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:34.894594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.895071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.895506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.896190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.896687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.897109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.927747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.928220 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.928654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.929097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'fault' on Instance uuid a9a4bada-b31b-4e25-8832-5024623a4632 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:34.968225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:34.976279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7ca5e6c1-94e7-4d2e-a87b-7a25fd2f87dd tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1307 microversion: 2.1 time: 0.092227 Sep 26 18:03:34.976840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 469/898] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:34 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:35.115105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:35.115677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:35.121611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:35.122103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:35.122544 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:35.123286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:35.123743 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:35.124175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:35.251115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:35.259430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c76e715d-f071-4fe9-ac56-dd848947f47f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.149012 Sep 26 18:03:35.259993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 430/899] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:35.709533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:35.709533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:35.716131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:35.716616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:35.717098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:35.717888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:35.718347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:35.718810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:35.847618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:35.855386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-38f851aa-d7ff-43b8-b2e8-0e6f05b839a0 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.151217 Sep 26 18:03:35.855950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 470/900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:35.999576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:36.000197 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:36.002750 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:36.008368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.016202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.016202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.016202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.016202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.016570 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.043006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.043481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.045608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.045608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lazy-loading 'fault' on Instance uuid a9a4bada-b31b-4e25-8832-5024623a4632 {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:36.085380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6220cf71845241c2ad61cf77e2ea9fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407b259f9ce40558c02a60e29e50c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:36.095640 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-168ae21a-6fd3-4bd6-969f-a5276a5ea5b8 tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 200 len: 1307 microversion: 2.1 time: 0.099855 Sep 26 18:03:36.096212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 431/901] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:36.283205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:36.283790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:36.290356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.290842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.291290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.291982 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.292443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.292875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.418379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:36.426056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bc44095b-864d-45e0-a7bd-1d324419ce5f tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.146915 Sep 26 18:03:36.426628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 471/902] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:36 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:36.878728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:36.879348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:36.885755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.886355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.886793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.887487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.887942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.888368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.017648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:37.025849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7c0815a1-40c6-413d-8def-f7459535f130 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1522 microversion: 2.1 time: 0.150981 Sep 26 18:03:37.026666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 432/903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:36 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:37.120052 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:37.120675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] [instance: a9a4bada-b31b-4e25-8832-5024623a4632] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:37.126696 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.127180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.127619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.128334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.128792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.129240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.142740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] HTTP exception thrown: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Request method failure captured: Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 HTTP/1.1 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMejYsqovqP4rOfhIM_Z4o6WWg_peMfeLioQ0SHTnrKBJqpbXSvdspnTSVbA0Dl5rQlUhK5Wu3OR2IAV0Dpg-QTjnLCRRGqgx9V9ZxTonT6iYKJrMZWTBgcQU-m6oHXJgTwUgIO3lGTEGcXtE8mImHeYODVZIF96yBwoKmNTvq1ZCz94 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 7407b259f9ce40558c02a60e29e50c93 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:03:37.144253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7407b259f9ce40558c02a60e29e50c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7407b259f9ce40558c02a60e29e50c93"}]}] Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 7407b259f9ce40558c02a60e29e50c93 Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1293169270 Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesSnapshotTestJSON-1293169270-project Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 6220cf71845241c2ad61cf77e2ea9fe9 Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesSnapshotTestJSON-1293169270-project Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. Sep 26 18:03:37.145867 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'a9a4bada-b31b-4e25-8832-5024623a4632'} Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:37.146991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. Sep 26 18:03:37.148597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:37.150666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] Returning 404 to user: Instance a9a4bada-b31b-4e25-8832-5024623a4632 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:37.150666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4f4a74e1-064f-4313-834d-84653bdc572a tempest-VolumesSnapshotTestJSON-1293169270 tempest-VolumesSnapshotTestJSON-1293169270-project] 10.222.0.49 "GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632" status: 404 len: 111 microversion: 2.1 time: 0.029634 Sep 26 18:03:37.150666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 472/904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:37 2022] GET /compute/v2.1/servers/a9a4bada-b31b-4e25-8832-5024623a4632 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:37.449524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:37.450145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:37.456036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.459131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.459131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.459131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.459131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.459627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.591542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:37.603096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7e4c1004-ef81-45d3-8852-83a38fc88482 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1362 microversion: 2.1 time: 0.156448 Sep 26 18:03:37.605330 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 433/905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:37 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:37.672050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a4239-37d1-4a0d-8d9d-35f96f93f7c1", "name": "network-vif-deleted", "tag": "d5c7742a-1615-4abe-a98f-3a8de2bdf219"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:37.682441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.685160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.685160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.694920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] Creating event network-vif-deleted:d5c7742a-1615-4abe-a98f-3a8de2bdf219 for instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 on hv-cinder-85931 Sep 26 18:03:37.699710 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-07b4c56e-6adc-4b36-902a-5f3994ed47bc req-e136d601-db41-4350-81ad-4f239f1fba61 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 Sep 26 18:03:37.700344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 473/906] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:38.049806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.050431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.057291 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.057798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.058244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.058964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.059429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.059868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.129712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:38.137644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-580e77c6-d9e3-46bf-834e-6cfa0add85ef tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1480 microversion: 2.1 time: 0.091759 Sep 26 18:03:38.138736 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 434/907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1480 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:38.635033 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.635727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.641932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.642453 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.642845 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.643593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.644048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.644481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.649395 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:38.777330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:38.785071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dc702d4d-a18f-438b-871b-5ddd90291160 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1548 microversion: 2.1 time: 0.154834 Sep 26 18:03:38.785858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 474/908] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:38.807473 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.808049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.814189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.814856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.815469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.816352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.817157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.817449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.896007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3b52c6fd-7e4f-4636-9d4c-c9d3a37954f2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092538 Sep 26 18:03:38.901955 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 435/909] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:39.162227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:39.162852 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:39.168949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.169491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.169934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.170639 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.171098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.171526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.204312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.204802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.205271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.205722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lazy-loading 'fault' on Instance uuid de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:39.249832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0416809c467846428e7df9a7c11ffb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222cdd96fb334e63a823cab0d33f939f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:39.265836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a3747d9c-3c84-46e9-a915-a7e5c36504d5 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 200 len: 1312 microversion: 2.1 time: 0.107319 Sep 26 18:03:39.277798 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 475/910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:39 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:40.119071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fa9d97-e143-4954-bd53-12a953f8c78b", "tag": "1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:40.128542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.129008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.129463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.140943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] Creating event network-changed:1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7 for instance d8fa9d97-e143-4954-bd53-12a953f8c78b on hv-cinder-85931 Sep 26 18:03:40.145920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-8faab7bc-4c91-4a7e-b4ef-73504565ea1e req-2fc68399-b843-41f9-90e1-456c363b2abd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031065 Sep 26 18:03:40.147828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 436/911] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:40.289500 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:40.290125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] [instance: de6a4239-37d1-4a0d-8d9d-35f96f93f7c1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:40.297056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.297620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.298057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.298785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.299240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.299662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.315987 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] HTTP exception thrown: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Request method failure captured: Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 HTTP/1.1 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegKNAjit7s3pSDX4eZsJuiExXyG9ODWhNqywnJvUzWbeIhOvLWYNNS1U26Kp05e7c-OIx67D5mGH0cCXXu8YGoJJQoCKGs6H03kBDsZCbgHDoy28bv2GsRi4j0ceA2pjH1qv85HSfImoJQAXxG1kvk6xkXz3ixMAcQZC8x1d-Prmn4 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:03:40.317665 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_222cdd96fb334e63a823cab0d33f939f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/222cdd96fb334e63a823cab0d33f939f"}]}] Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 222cdd96fb334e63a823cab0d33f939f Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1533981578 Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0416809c467846428e7df9a7c11ffb0e Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1533981578-project Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. Sep 26 18:03:40.319704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'de6a4239-37d1-4a0d-8d9d-35f96f93f7c1'} Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:40.320600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. Sep 26 18:03:40.322157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:40.323679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] Returning 404 to user: Instance de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:40.323679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c5e33290-b2ff-4642-a76e-e33e1cdecdd3 tempest-ServerRescueNegativeTestJSON-1533981578 tempest-ServerRescueNegativeTestJSON-1533981578-project] 10.222.0.49 "GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1" status: 404 len: 111 microversion: 2.1 time: 0.033447 Sep 26 18:03:40.323679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 476/912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:40 2022] GET /compute/v2.1/servers/de6a4239-37d1-4a0d-8d9d-35f96f93f7c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:47.816343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-43bbe626-1473-4a17-a82a-180b1c332d15 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981cc3af0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:47.865088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-43bbe626-1473-4a17-a82a-180b1c332d15 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7cfc2374-6bd2-44aa-a7af-e5e4c596b583" status: 200 len: 351 microversion: 2.1 time: 0.053046 Sep 26 18:03:47.865715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 437/913] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:03:47 2022] GET /compute/v2.1/os-volumes/7cfc2374-6bd2-44aa-a7af-e5e4c596b583 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:49.493507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-30e8a584-cacd-4cca-8088-7f44c1fa21fc tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981df9700>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:49.542742 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-30e8a584-cacd-4cca-8088-7f44c1fa21fc tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a93d3430-5a62-4f22-8fc7-3f36e0114abe" status: 200 len: 351 microversion: 2.1 time: 0.052937 Sep 26 18:03:49.543325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 477/914] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:03:49 2022] GET /compute/v2.1/os-volumes/a93d3430-5a62-4f22-8fc7-3f36e0114abe => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:53.445098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=13 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:53.445907 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:53.450003 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-965062654"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:53.450610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:53.456529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:53.458335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:53.458335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:53.458335 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:53.458668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:53.459101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:53.589105 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.network.security_group_api [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Removing security group 044f911f-1f6c-4070-a037-fa310154b3a8 from port 92394117-76f4-4f16-b60c-6adb351db3cd Sep 26 18:03:53.995464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b0eba321-b7fd-42e5-aa98-fb0de036afeb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action" status: 202 len: 0 microversion: 2.1 time: 0.551654 Sep 26 18:03:53.996158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 438/915] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:03:53 2022] POST /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:03:54.008842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:54.014306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=33 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:54.015062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=14 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:54.020787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.021429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.021954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.045918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] Creating event network-changed:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:03:54.055275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-b8a6b239-d999-4c36-90d7-4e042348cfcd req-23bb3ee8-a133-404a-b373-50b2973763e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050086 Sep 26 18:03:54.056170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 478/916] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.335568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4c817072-bab5-41e5-8c47-dd79cdefeb5b tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981c78f70>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.410285 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4c817072-bab5-41e5-8c47-dd79cdefeb5b tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b1d800a8-32da-4f2d-b53f-80b82b49d040" status: 200 len: 350 microversion: 2.1 time: 0.078314 Sep 26 18:03:54.411801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 439/917] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes/b1d800a8-32da-4f2d-b53f-80b82b49d040 => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.425443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4ba86aac-b735-4c43-be18-8ece829bc33d tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981df9670>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.517741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4ba86aac-b735-4c43-be18-8ece829bc33d tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096807 Sep 26 18:03:54.518318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 479/918] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:54.535016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1d266532-a642-428c-962a-f86c70efeb4a tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981cc35e0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.635079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1d266532-a642-428c-962a-f86c70efeb4a tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104095 Sep 26 18:03:54.635879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 440/919] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.651910 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2313ccea-b431-4764-8219-9aac0b947cde tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981bfe940>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.769981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2313ccea-b431-4764-8219-9aac0b947cde tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123424 Sep 26 18:03:54.770971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 480/920] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:54.785253 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2d61fce5-7f76-4a0e-bdd2-b763010246b6 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981c6fe50>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.879505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2d61fce5-7f76-4a0e-bdd2-b763010246b6 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098629 Sep 26 18:03:54.880074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 441/921] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.894417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a0d24b17-be90-4dc4-90c1-3691ffda4c68 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981d9a790>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.979117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a0d24b17-be90-4dc4-90c1-3691ffda4c68 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088403 Sep 26 18:03:54.979714 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 481/922] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.994266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5a9e96ad-c4ef-4188-9b4f-1a7e0183526b tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981c78d30>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.083223 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5a9e96ad-c4ef-4188-9b4f-1a7e0183526b tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093298 Sep 26 18:03:55.083790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 442/923] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:55.102422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2a516016-95de-4df5-b529-551c28552aea tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981d9a820>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.181801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2a516016-95de-4df5-b529-551c28552aea tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087797 Sep 26 18:03:55.182374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 482/924] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Sep 26 18:03:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:55.195841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f997392-ea11-4170-9f59-cfe8373d5df3 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] Calling method '.version_select at 0x7ff981c40430>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.281358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8f997392-ea11-4170-9f59-cfe8373d5df3 tempest-VolumesTestJSON-806857598 tempest-VolumesTestJSON-806857598-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089246 Sep 26 18:03:55.281857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 443/925] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 18:03:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:55.731170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.731796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:55.738979 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.739477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.739913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.740616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.741783 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.742223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.835703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lazy-loading 'services' on Instance uuid d0640c8d-e812-405e-ad2d-1c98fb61b382 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:03:56.072674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:56.082155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.082693 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.083305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.094424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] Creating event network-changed:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:03:56.106386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-bac2a1af-12fb-4947-9d1d-5d166b7820cb req-56992fdb-c98f-4869-b1bd-34e750dbfdaa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Sep 26 18:03:56.106386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 444/926] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:56.111836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-529b85a9-1f3f-4ba9-9950-95c008450189 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments/16df46df-19d4-4ecc-bd73-49a39a8739da" status: 202 len: 0 microversion: 2.1 time: 0.384423 Sep 26 18:03:56.112949 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 483/927] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:03:55 2022] DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments/16df46df-19d4-4ecc-bd73-49a39a8739da => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:03:56.123460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:56.126367 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:56.135357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.136082 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.136713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.137630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.138289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.138971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.178049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8dd0cc33-4ce3-4804-821c-72ed67bb6d5f tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059113 Sep 26 18:03:56.178049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 445/928] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:56 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:57.192042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:57.194352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:57.201194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:57.201720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:57.202162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:57.203169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:57.203307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:57.203745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:57.234890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-70beeced-f8e6-4687-a102-25f19bdc4049 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048258 Sep 26 18:03:57.236591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 484/929] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:57 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:58.248843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:58.251053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:58.257667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.258656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.259097 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.259796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.260253 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.260716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.289464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b9b421d7-883a-4932-b744-3ae6dcbf8d58 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044541 Sep 26 18:03:58.290010 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 446/930] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:03:58 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:03:58.300797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:58.301346 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:58.307828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.310778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.310778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.310778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.310778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.311109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.386017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] HTTP exception thrown: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 is not attached to volume 16df46df-19d4-4ecc-bd73-49a39a8739da Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Request method failure captured: Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments/16df46df-19d4-4ecc-bd73-49a39a8739da HTTP/1.1 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMeimoaU5ywTyWNu2OSDyqw76kt23BrNYBsXLGrASopeWOYh5QLBENhxaqumMuXtb7PuciMJGRcTZKuIW1YJXmHTZbemcVTjcQ5i13OdN_RGLOxglGusmjK5HUAGenrPRa_melTfbI7ZOZlG-JuQHs7uQtKtVvMEmTgEA0Ty6xhmJ1Ls Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: df8e59bd01c64c8f8d7302ff01bba771 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:03:58.388459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df8e59bd01c64c8f8d7302ff01bba771"}]}] Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: df8e59bd01c64c8f8d7302ff01bba771 Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-TestMinimumBasicScenario-9042936-project Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0f74dd694d7f4f999130294e1f8828d7 Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-TestMinimumBasicScenario-9042936-project Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:03:58.389879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 is not attached to volume 16df46df-19d4-4ecc-bd73-49a39a8739da Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'server_id': 'd0640c8d-e812-405e-ad2d-1c98fb61b382', 'id': '16df46df-19d4-4ecc-bd73-49a39a8739da'} Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16df46df-19d4-4ecc-bd73-49a39a8739da. Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:58.390757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 is not attached to volume 16df46df-19d4-4ecc-bd73-49a39a8739da Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 is not attached to volume 16df46df-19d4-4ecc-bd73-49a39a8739da Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:03:58.392287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Returning 404 to user: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 is not attached to volume 16df46df-19d4-4ecc-bd73-49a39a8739da {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:58.393501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3bb4c83d-208e-4fc8-8f89-dcb2d0ac153c tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments/16df46df-19d4-4ecc-bd73-49a39a8739da" status: 404 len: 154 microversion: 2.1 time: 0.093173 Sep 26 18:03:58.393501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 485/931] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:03:58 2022] DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382/os-volume_attachments/16df46df-19d4-4ecc-bd73-49a39a8739da => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:59.695327 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:59.696549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:59.702893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.703385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.703844 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.704540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.705313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.705780 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.731226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:04:00.068418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a3cb7f13-bf07-4b03-839e-94ef0563753d tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 204 len: 0 microversion: 2.1 time: 0.376580 Sep 26 18:04:00.069031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 447/932] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:03:59 2022] DELETE /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:04:00.091358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:00.091870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:00.098753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.099246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.099908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:00.100624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.101119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.101573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:00.274037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:00.282288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-946beff2-1d49-415e-b625-849c68f4c4bb tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1554 microversion: 2.1 time: 0.195179 Sep 26 18:04:00.282877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 486/933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:00 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:01.306262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:01.307008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:01.313272 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:01.313775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:01.314227 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:01.314960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:01.315426 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:01.315933 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:01.450779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:01.458552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a0dd4459-774b-4cf4-b8e1-7e951204a8a0 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1554 microversion: 2.1 time: 0.156590 Sep 26 18:04:01.459176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 448/934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:01 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:02.482807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:02.483691 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:02.491607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.492100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.492616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.493342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.493812 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.494457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.629877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:02.637793 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c6464df2-1684-462f-800a-c11d1a085853 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1554 microversion: 2.1 time: 0.159932 Sep 26 18:04:02.638359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 487/935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:02 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:02.918875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:02.919387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:02.927449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.927449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.927449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.927838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.928317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.928739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.952649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-178dfdc7-b69b-4841-a338-9a02ea8e9a30 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/ips" status: 200 len: 147 microversion: 2.1 time: 0.037719 Sep 26 18:04:02.953246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 449/936] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 18:04:02 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:03.661834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:03.662459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:03.669329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:03.669815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:03.670247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:03.670938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:03.671461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:03.671839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:03.830733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:03.843597 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-099c3998-7a05-4f55-b463-403fdb596cd5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1554 microversion: 2.1 time: 0.185679 Sep 26 18:04:03.844114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 488/937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:03 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:03.879848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0640c8d-e812-405e-ad2d-1c98fb61b382", "name": "network-vif-deleted", "tag": "92394117-76f4-4f16-b60c-6adb351db3cd"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:03.890585 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:03.891260 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:03.891697 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:03.907648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] Creating event network-vif-deleted:92394117-76f4-4f16-b60c-6adb351db3cd for instance d0640c8d-e812-405e-ad2d-1c98fb61b382 on hv-cinder-85931 Sep 26 18:04:03.917180 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-1f3d7612-a0f0-4d4e-81c5-d3b6133bf9c4 req-fc102afd-f824-494c-9b35-603cddefd769 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038350 Sep 26 18:04:03.917180 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 450/938] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:04.866681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:04.867276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:04.873999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.874494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.874934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.875628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.876125 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.876559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.910221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.910625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.911065 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.911592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lazy-loading 'fault' on Instance uuid d0640c8d-e812-405e-ad2d-1c98fb61b382 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:04:04.960280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f74dd694d7f4f999130294e1f8828d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8e59bd01c64c8f8d7302ff01bba771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:04.975345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47d8c53-d98b-4618-8e83-65f5ba2efd96"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:04.979941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ff1da5c2-caf6-4e88-acf8-cfe40678f3e5 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 200 len: 1348 microversion: 2.1 time: 0.113596 Sep 26 18:04:04.979941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 489/939] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:04 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:04.980161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:04.984677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.985453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.986120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.987016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.987567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.988093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.002044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:06.002703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] [instance: d0640c8d-e812-405e-ad2d-1c98fb61b382] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:06.009359 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.009851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.010291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.010997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.011453 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.012477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.026550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] HTTP exception thrown: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Request method failure captured: Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 HTTP/1.1 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMeimoaU5ywTyWNu2OSDyqw76kt23BrNYBsXLGrASopeWOYh5QLBENhxaqumMuXtb7PuciMJGRcTZKuIW1YJXmHTZbemcVTjcQ5i13OdN_RGLOxglGusmjK5HUAGenrPRa_melTfbI7ZOZlG-JuQHs7uQtKtVvMEmTgEA0Ty6xhmJ1Ls Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: df8e59bd01c64c8f8d7302ff01bba771 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:04:06.028282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df8e59bd01c64c8f8d7302ff01bba771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df8e59bd01c64c8f8d7302ff01bba771"}]}] Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: df8e59bd01c64c8f8d7302ff01bba771 Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9042936 Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-TestMinimumBasicScenario-9042936-project Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 0f74dd694d7f4f999130294e1f8828d7 Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-TestMinimumBasicScenario-9042936-project Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. Sep 26 18:04:06.035833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'd0640c8d-e812-405e-ad2d-1c98fb61b382'} Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:04:06.036713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. Sep 26 18:04:06.038334 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:04:06.039593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Returning 404 to user: Instance d0640c8d-e812-405e-ad2d-1c98fb61b382 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:04:06.039593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5fc66c64-0478-4952-a206-39f756398eaa tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382" status: 404 len: 111 microversion: 2.1 time: 0.031593 Sep 26 18:04:06.039593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 490/940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:05 2022] GET /compute/v2.1/servers/d0640c8d-e812-405e-ad2d-1c98fb61b382 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:04:06.041438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aba3e064-6dc6-4fdb-97f6-09986e365ce2 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] Calling method '.version_select at 0x7ff981e4b820>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:06.094778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-033a3ad4-c124-4251-8516-8f4953f557c2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124326 Sep 26 18:04:06.101094 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 451/941] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:04:04 2022] POST /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:06.166902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aba3e064-6dc6-4fdb-97f6-09986e365ce2 tempest-TestMinimumBasicScenario-9042936 tempest-TestMinimumBasicScenario-9042936-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-278174934" status: 202 len: 0 microversion: 2.1 time: 0.132059 Sep 26 18:04:06.167477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 491/942] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Sep 26 18:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-278174934 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:04:14.747536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47d8c53-d98b-4618-8e83-65f5ba2efd96"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:14.750163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:14.756418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.756913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.757388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.758098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.758551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.759266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.858756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: POST /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments HTTP/1.1 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 74 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:04:14.860810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {"volumeAttachment": {"volumeId": "a47d8c53-d98b-4618-8e83-65f5ba2efd96"}} Sep 26 18:04:14.862329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'server_id': '921f12a9-6f62-478f-a547-9a46350096ae', 'body': {'volumeAttachment': {'volumeId': 'a47d8c53-d98b-4618-8e83-65f5ba2efd96'}}} Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:14.866169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:14.867624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 400 to user: Invalid volume: volume a47d8c53-d98b-4618-8e83-65f5ba2efd96 is already attached to instances: 921f12a9-6f62-478f-a547-9a46350096ae {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-241c4316-4547-412d-93bd-bdcf40b8b223 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120551 Sep 26 18:04:14.869069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 452/943] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:04:14 2022] POST /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:04:14.936356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:14.937195 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:14.943180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.943669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.944104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.944797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.945650 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.946235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:15.035154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'services' on Instance uuid 921f12a9-6f62-478f-a547-9a46350096ae {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:04:15.268291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b4750d53-bd24-479d-b418-2b2a9189f53c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments/a47d8c53-d98b-4618-8e83-65f5ba2efd96" status: 202 len: 0 microversion: 2.1 time: 0.336704 Sep 26 18:04:15.274491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 492/944] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:04:14 2022] DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments/a47d8c53-d98b-4618-8e83-65f5ba2efd96 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:04:15.278681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:15.280834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:15.287093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:15.287786 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:15.288226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:15.294081 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:15.295221 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:15.295724 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:15.339379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d8fa96bd-d97d-483c-a34f-1389b3862215 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064155 Sep 26 18:04:15.340616 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 453/945] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:04:15 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:16.353070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:16.356321 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:16.362475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.362954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.363388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.364208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.364661 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.365083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.396585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9eb24822-554b-4505-b18c-c69e81501dab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048278 Sep 26 18:04:16.397261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 493/946] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:04:16 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:17.409526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:17.411675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:17.418448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.418926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.419362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.420068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.420517 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.420938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.452203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e2e18f1f-a86a-458f-8a92-a42799841d6e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 Sep 26 18:04:17.452740 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 454/947] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:04:17 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:18.464216 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.467231 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.474306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.474800 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.475241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.475951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.476529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.477042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.507030 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1e6a3199-e0f1-45a9-a858-20721f4b3bf2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046945 Sep 26 18:04:18.507622 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 494/948] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:04:18 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:04:18.573358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.573895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.580875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.581892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.583691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.584732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.585199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.585811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.627554 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:04:18.965071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e8afb39d-78da-4fdb-a65a-6a361895cd03 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 204 len: 0 microversion: 2.1 time: 0.395206 Sep 26 18:04:18.965691 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 455/949] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:04:18 2022] DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:04:18.973789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.975299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.980262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.980745 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.981181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.982405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.982862 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.983287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:19.116006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:19.124209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8c544670-acf0-48f3-9226-f7c31e82f463 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1678 microversion: 2.1 time: 0.154199 Sep 26 18:04:19.124815 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 495/950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:18 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:20.148429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:20.149072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:20.155834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.157806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.157806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.157806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.158106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.158303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.336516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:20.340063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:20.344646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f0c197cf-ee0a-466a-8dd8-fc3cd494e98d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1678 microversion: 2.1 time: 0.200581 Sep 26 18:04:20.345210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 456/951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:20 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:21.368416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:21.369156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:21.377182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.377980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.378600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.379309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.379798 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.380224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.617772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:21.634158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0054ec0f-ae9c-4107-a64c-bd4c766e4430 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1678 microversion: 2.1 time: 0.270166 Sep 26 18:04:21.635331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 496/952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:21 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:22.670777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:22.671551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:22.680406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:22.680906 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:22.681377 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:22.682131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:22.682743 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:22.683182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:23.226302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:23.236343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a04921ee-13c0-4c2b-a8f3-46087f4f97b2 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1678 microversion: 2.1 time: 0.577711 Sep 26 18:04:23.236926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 457/953] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:22 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1678 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:23.691506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921f12a9-6f62-478f-a547-9a46350096ae", "name": "network-vif-deleted", "tag": "f5160b1d-20ef-4a96-9b5a-cc5148bd71f9"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:23.710656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:23.713348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:23.713744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:23.741048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] Creating event network-vif-deleted:f5160b1d-20ef-4a96-9b5a-cc5148bd71f9 for instance 921f12a9-6f62-478f-a547-9a46350096ae on hv-cinder-85931 Sep 26 18:04:23.753805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-4fc61be2-20d1-414c-996d-c221b7096795 req-b8196f57-8af2-4d79-98fb-5e291157492e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066061 Sep 26 18:04:23.766051 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 497/954] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:24.266378 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:24.267962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:24.274474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:24.276869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.277340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.278149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.278944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.279595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.280274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.319129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.319930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.320563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.321523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'fault' on Instance uuid 921f12a9-6f62-478f-a547-9a46350096ae {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:04:24.390994 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:24.406637 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-df6280a9-175e-4ce9-a954-986db965d5a7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 200 len: 1331 microversion: 2.1 time: 0.143989 Sep 26 18:04:24.408103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 458/955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:24 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:24.913568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:24.913568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:24.913568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:24.913568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.915876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.916627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.917645 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.920077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.921398 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.927571 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:24.970741 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3892259d-a89a-49d8-82db-0453c82bc4f9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/ips" status: 200 len: 151 microversion: 2.20 time: 0.079101 Sep 26 18:04:24.971401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 498/956] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 18:04:24 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:04:25.437528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:25.438487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:25.452337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.452832 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.453296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.454044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.454499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.455196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.484030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae HTTP/1.1 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:04:25.484226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:04:25.485684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '921f12a9-6f62-478f-a547-9a46350096ae'} Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:04:25.486547 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:04:25.487790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:04:25.490822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:04:25.491876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a53c517b-5d9e-4d7d-9ad5-6e0f341cb4db tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 404 len: 111 microversion: 2.1 time: 0.062440 Sep 26 18:04:25.502164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-60bd4e45-1880-4e72-acaa-0e678cad4df3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '.version_select at 0x7ff981d97ee0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:25.507669 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 459/957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:25 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:04:25.630574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-60bd4e45-1880-4e72-acaa-0e678cad4df3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443303247" status: 202 len: 0 microversion: 2.1 time: 0.132371 Sep 26 18:04:25.632389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 499/958] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 18:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443303247 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:04:26.534960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-36f5afa9-098f-4b1e-8441-c9f3c92bcbde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: .version_select at 0x7ff981c26550>, body: {"keypair": {"name": "tempest-keypair-2072428253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs5Xhdbi/v8WG/mDEe4AIWcEk/rYxikNlk3VfAfHIHOUh8kuJs7ik+LTgtWEEOshw5BrR7zCeRwk9D1THIZRxJof3dYqN47vKaVN5OAQwr/P0xWfHyHxPLSYJ3P/OB6MQ=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:26.552622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-36f5afa9-098f-4b1e-8441-c9f3c92bcbde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:04:26.556310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-36f5afa9-098f-4b1e-8441-c9f3c92bcbde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:04:26.704873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-36f5afa9-098f-4b1e-8441-c9f3c92bcbde tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173764 Sep 26 18:04:26.705577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 460/959] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:04:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:29.823600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1761036723", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c4905c3-b6d4-4b95-988f-f86fad27c092"}], "security_groups": [{"name": "tempest-securitygroup--978084583"}], "key_name": "tempest-keypair-2072428253", "user_data": "}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:30.006880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:30.007555 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:30.016810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] validate_networks() for [('5c4905c3-b6d4-4b95-988f-f86fad27c092', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:04:30.031198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.031751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.032448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:30.033628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.034326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.035009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:30.099251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lazy-loading 'flavor' on Instance uuid 5b6baf32-af4c-4b68-99f5-ce32e42e917c {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:04:30.718604 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cd94eff2-b292-4c70-850e-6182f9eba34b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/action" status: 202 len: 0 microversion: 2.20 time: 0.716702 Sep 26 18:04:30.719256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 461/960] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 18:04:30 2022] POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:04:30.741614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:30.742778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:30.752825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.754411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.755093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:30.757945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.758651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.759704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:31.081404 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:31.090033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:31.091739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:31.093094 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b3551b92-dbed-4bc1-8737-bb74fae2f65a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.367708 Sep 26 18:04:31.094187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 462/961] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:30 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:31.132419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:04:31.133569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:04:31.134517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:04:31.134932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:04:31.135507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:04:31.145724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:31.146440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:31.146876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:31.147761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:31.148446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:31.148875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:31.174023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:04:31.177013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Getting quotas for user 4d46bbda38da4cf1804dee850217f11d and project cc91a89f645645c5be0747fa7cc91bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:04:31.190105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:04:31.192437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:04:31.371883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7687becc-f93d-4f65-8ea7-6930a08369bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.555075 Sep 26 18:04:31.375871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 500/962] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:04:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 18:04:31.388840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7751d8c0-c716-452d-96cd-4548e29e4e8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:31.389610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7751d8c0-c716-452d-96cd-4548e29e4e8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:31.474191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7751d8c0-c716-452d-96cd-4548e29e4e8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:31.486521 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7751d8c0-c716-452d-96cd-4548e29e4e8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1242 microversion: 2.1 time: 0.103594 Sep 26 18:04:31.488414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 463/963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:31 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:32.121780 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:32.122588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:32.129482 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.129967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.130409 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:32.131098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.131554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.131980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:32.337163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:32.353163 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:32.354765 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:32.356187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6477c224-d382-4e8b-9d8b-8d39fab0b51c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.238990 Sep 26 18:04:32.379353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 501/964] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:32 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:32.510271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:32.511008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:32.519813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.520368 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.520869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:32.521676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.522123 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.522551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:32.591433 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:32.600370 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b6abd0ce-f6ea-49b2-8a48-b5a2eb72b1ac tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1246 microversion: 2.1 time: 0.094356 Sep 26 18:04:32.601730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 464/965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:32 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:33.391078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:33.391078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:33.395784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:33.396268 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:33.396700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:33.397433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:33.397886 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:33.398306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:33.563480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:33.573592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:33.575409 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:33.576579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cf5f95d3-c6db-4179-b3e6-2664195de1bd tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.191823 Sep 26 18:04:33.577598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 502/966] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:33 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:33.623693 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:33.624716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:33.633200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:33.633772 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:33.634242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:33.634952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:33.635415 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:33.635843 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:33.696420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d91f87bf-8b4e-4718-8629-1fc4216cd6fe tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Action: 'create', calling method: .version_select at 0x7ff981d28b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-327912498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvKdi846Nqsyp6/h49WdwitWnsTF1QSoB1di16UWaH0cOpRl7o1YI+n5W+Zs+u/PHtCpPxzb9snFQzYg5Py5NuZBYMNAKK+XqPXQ/rPYX74S2flrxcoZTEIBI+YcGYK3A=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:33.713009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-d91f87bf-8b4e-4718-8629-1fc4216cd6fe tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Getting quotas for project 50b90dee570a4fd4bb2c5dafcfcd3c6c. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:04:33.717977 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-d91f87bf-8b4e-4718-8629-1fc4216cd6fe tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Getting quotas for user ad574850851d48f29cdb17bb26149c30 and project 50b90dee570a4fd4bb2c5dafcfcd3c6c. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:04:33.724766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:33.732730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2887c6c6-d687-4b21-a8ea-3cd41867bba6 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1246 microversion: 2.1 time: 0.112822 Sep 26 18:04:33.745674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 503/967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:33 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:33.784271 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d91f87bf-8b4e-4718-8629-1fc4216cd6fe tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.299999 Sep 26 18:04:33.784889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 465/968] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:04:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:34.603228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:34.603853 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:34.611158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.611889 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.612485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.613373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.613984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.614569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.755754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:34.756395 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:34.767188 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.768944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.769700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.770423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.770890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.771325 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.795287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:34.810073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:34.813386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:34.814775 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e0de196c-1f70-4596-98fe-6523f7b0b969 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.215643 Sep 26 18:04:34.831045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 504/969] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:34 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:04:34.876311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:34.884077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-012f435b-b500-4dae-a4aa-4f0e0e86717e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1246 microversion: 2.1 time: 0.132367 Sep 26 18:04:34.884711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 466/970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:34 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:35.844614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:35.845844 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:35.852503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.853200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.853821 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:35.854918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.855533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.856134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:35.911472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:35.921654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:35.928702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.934950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.934950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:35.934950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.936217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.936755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:36.059965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:36.071450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0074f3ef-d561-4785-bfd9-f0054ef0c9ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1294 microversion: 2.1 time: 0.167592 Sep 26 18:04:36.072374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 467/971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:35 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:36.079151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:36.096167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:36.097678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:36.098964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-591e1797-ecb9-49cf-9053-fbe40cd1ef17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.258865 Sep 26 18:04:36.099540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 505/972] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:35 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:37.099886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:37.101296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:37.114749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.115351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.115807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.116672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.117145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.118490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.132226 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:37.133686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:37.156847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.157659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.158647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.163601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.163601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.163601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.213719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:37.237476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f721c5a0-576f-4feb-ae67-32dbb0cded5e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1312 microversion: 2.1 time: 0.144584 Sep 26 18:04:37.238821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 468/973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:37 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:37.399732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:37.408556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:37.410188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:37.411529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5e020cbb-e505-43b1-b107-10ecb3cb330e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.285089 Sep 26 18:04:37.412166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 506/974] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:37 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:38.262019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:38.262847 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:38.270218 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.270704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.271140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.271841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.272301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.272758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.409836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:38.417314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-98c52576-495e-4dbc-bd4a-0f69fa48473f tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.159337 Sep 26 18:04:38.417882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 469/975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:38 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:38.438081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:38.438731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:38.445206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.445801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.446185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.446876 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.447325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.447751 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.573774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:38.581837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:38.583283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:38.584445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c904b371-71a0-453a-a200-9889d6b6027b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.151083 Sep 26 18:04:38.585001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 507/976] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:38 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:38.988241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f882295-9a3c-488b-af76-a40c3a07fdce", "tag": "3b139773-6d90-4d3c-bcb6-50875aa43976"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:38.999068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.999960 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:39.000877 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:39.013988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] Creating event network-changed:3b139773-6d90-4d3c-bcb6-50875aa43976 for instance 0f882295-9a3c-488b-af76-a40c3a07fdce on hv-cinder-85931 Sep 26 18:04:39.018896 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-10602d1f-19c2-4c60-8460-3fac7062fe22 req-8414d2ae-aee1-4fdb-babb-4c086cab5c4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034338 Sep 26 18:04:39.020658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 470/977] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:39.440294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:39.440952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:39.447536 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:39.448021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:39.448461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:39.449159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:39.449641 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:39.450066 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:39.610966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:39.612382 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:39.618806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:39.619312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:39.619747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:39.620587 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:39.621046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:39.621507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:39.657967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:39.670634 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7b239ac8-5816-4670-a3d8-f441d07161b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.234253 Sep 26 18:04:39.671234 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 508/978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:39 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:39.754842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:39.764382 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:39.765861 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:39.767056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4433dec4-3546-4383-885d-e76d30052cb0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.161013 Sep 26 18:04:39.767612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 471/979] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:39 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:04:40.694204 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:40.694820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:40.701863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.702343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.702776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.703465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.703920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.704350 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.791825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:40.792443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:40.799122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.799546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.799990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.800698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.801158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.801614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.834813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:40.843105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-276fb8ac-f098-4ff8-8aa3-7d630f24a209 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.152773 Sep 26 18:04:40.843912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 509/980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:40 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:40.930374 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:40.938758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:40.940341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:40.941702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ba2bf066-b284-4b9e-8fdc-3088cabe7707 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.153755 Sep 26 18:04:40.942267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 472/981] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:40 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:04:41.866511 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:41.867127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:41.868964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:41.869769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=6 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:41.875572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.883481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.883481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:41.883481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.883481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.883919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:41.966568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:41.967184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:41.973926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.974414 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.974850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:41.975577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.976036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.976464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:42.024526 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:42.033025 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-001b36b4-6096-41f1-937d-2ec9f11a15f7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.170584 Sep 26 18:04:42.034079 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 510/982] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:41 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:42.108512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:42.116942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:42.118708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:42.120142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-57106c44-209e-4d62-8e9c-8de3689d2140 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.157345 Sep 26 18:04:42.120722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 473/983] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:41 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:42.992752 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:42.993312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:43.000217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.000694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.001132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.001839 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.002358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.002712 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.025202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8ea971a0-3528-4f86-81fd-926fb2096da4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036347 Sep 26 18:04:43.026037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 511/984] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 18:04:42 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:43.061759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:43.062440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:43.068392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.068882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.069355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.070287 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.070752 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.071222 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.148411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:43.149590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:43.157602 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.158230 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.158778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.159614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.160251 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.160887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.218091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:43.226066 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4e08716d-8dea-44e4-9c02-5d172ed252d7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.169499 Sep 26 18:04:43.226644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 474/985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:43 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:43.314628 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:43.322698 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:43.324152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:43.325340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ffc89b59-b752-4e3a-8e87-ae667765fb7a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.181514 Sep 26 18:04:43.326545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 512/986] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:43 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:44.249771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:44.250389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:44.252314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=10 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:44.257806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.258292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.258730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:44.259425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.259882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.260311 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:44.278303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:44.351519 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:44.352108 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:44.359541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.360035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.360515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:44.361273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.361785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.362768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:44.399043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:44.407542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fbaa1ba6-906a-4484-87c4-cae7884521c4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.161617 Sep 26 18:04:44.408251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 475/987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:44 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:44.498437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:44.506739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:44.514360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:44.514360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0b205b68-732a-452b-92e1-4e2686ab75de tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.162132 Sep 26 18:04:44.514360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 513/988] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:44 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:04:44.686495 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:44.688831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:44.695468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.695954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.696399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:44.697099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:44.697589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:44.698021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.430697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:45.431290 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:45.438072 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.438613 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.439118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.439936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.440414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.440884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.572736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:45.581353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9736aa7e-7af8-4b04-9c77-81b9b6efc92a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.154562 Sep 26 18:04:45.581928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 514/989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:45 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:45.586450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:45.587051 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:45.592737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.593235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.593675 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.594366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.594822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.595244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.738796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:45.747939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:45.750128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:45.751323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dc5bb831-3a6b-4500-8c61-145d82e06e6d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.168495 Sep 26 18:04:45.751872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 515/990] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:45 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:46.318365 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-be23d12b-e43c-44d3-8dd2-56b2dbeb95b2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.635656 Sep 26 18:04:46.319129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 476/991] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:04:44 2022] POST /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 194 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:46.604485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:46.605133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:46.611565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.612041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.612469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.613169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.613626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.614089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.752097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:46.760134 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-02a967c9-4170-4ed6-940d-e8f2569aeb06 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.159388 Sep 26 18:04:46.760699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 516/992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:46 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:46.779315 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:46.780080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:46.786345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.786835 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.787276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.787970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.788430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.788862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.921450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:46.929561 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:46.931029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:46.932190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-74524740-aae1-427b-aa4b-cc73bd1d8016 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.157919 Sep 26 18:04:46.932748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 477/993] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:46 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:47.782684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:47.783303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:47.789800 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.790292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.790735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:47.791498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.791955 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.792386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:47.796288 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:47.923916 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:47.931930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-60f6e952-ba33-4244-a145-b16b4ff9be5d tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.153145 Sep 26 18:04:47.932511 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 517/994] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:47 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:47.960029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:47.960785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:47.967536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.968026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.968578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:47.969314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.969771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.970226 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:48.103968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:48.113467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:48.114931 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:48.116220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dcded30d-4a8e-47ce-93c2-ed01647da2ba tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.160746 Sep 26 18:04:48.116776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 478/995] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:47 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:48.955722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:48.956344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:48.962847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:48.963335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:48.963778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:48.964471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:48.964929 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:48.965425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:49.099392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:49.106890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-511fe219-9776-4eae-9078-03219927cc8c tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.155594 Sep 26 18:04:49.107576 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 518/996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:48 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:49.142806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:49.143409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:49.149842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:49.150323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:49.151013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:49.151699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:49.152154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:49.152577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:49.281165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:49.289700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:49.291152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:49.292322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6e304191-8ef5-46d6-8526-1db2c9df2992 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.153948 Sep 26 18:04:49.292876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 479/997] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:49 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:50.129762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:50.135983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:50.138007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:50.138491 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:50.138923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.139617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:50.140067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:50.140490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.276129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:50.276432 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f882295-9a3c-488b-af76-a40c3a07fdce", "name": "network-vif-plugged", "status": "completed", "tag": "3b139773-6d90-4d3c-bcb6-50875aa43976"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:50.284857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3a16368c-79c6-428a-9565-415ce17c8409 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.159175 Sep 26 18:04:50.285463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 519/998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:50 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:50.287881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:50.288575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:50.289056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.300612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] Creating event network-vif-plugged:3b139773-6d90-4d3c-bcb6-50875aa43976 for instance 0f882295-9a3c-488b-af76-a40c3a07fdce on hv-cinder-85931 Sep 26 18:04:50.307058 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-87cbb5f2-41b2-4d2c-a5a2-f2a0687f78b5 req-88b21547-933a-41e3-bcdf-4bfa93a2f117 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036568 Sep 26 18:04:50.307825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 480/999] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:50.317378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:50.318223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:50.324607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:50.325077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:50.325544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.326235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:50.326686 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:50.327105 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.484032 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:50.493048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:50.494826 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:50.496087 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6a438b93-2a30-418a-8b9e-1005c6482b2a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.182780 Sep 26 18:04:50.496730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 520/1000] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:50 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:51.308423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:51.309122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:51.316217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.316701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.317133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.317857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.318310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.318732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.454345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:51.462511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5cd83872-ed28-4a08-b01f-964097ca00e7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.158232 Sep 26 18:04:51.463142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 481/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:51 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:51.520546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:51.521166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:51.528667 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.529167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.537366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.537366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.537366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.537366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.678531 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:51.687387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:51.689038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:51.690227 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d6bfc7af-4f49-4c5c-945e-add82e2f453f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.173706 Sep 26 18:04:51.690940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 521/1002] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:51 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:52.486212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:52.486833 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:52.493210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.501482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.501482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.501482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.501482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.502018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.630641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:52.638302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e4d0eab1-b39e-4dcd-8602-a49bdd0008b0 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1367 microversion: 2.1 time: 0.156210 Sep 26 18:04:52.638859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 482/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:52 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:52.716146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:52.723935 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:52.731289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.731773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.737176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.737176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.737176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.737176 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.875622 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:52.884043 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:52.885653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:52.886899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f524d57c-16ec-49b2-9208-b08c16dcff17 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1743 microversion: 2.20 time: 0.175176 Sep 26 18:04:52.887465 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 522/1004] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:52 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:53.667364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:53.671210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:53.675771 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.676256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.676720 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.677453 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.677913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.678364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.818647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:53.829868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-95743c29-f62e-4899-b50a-ac35edf0e830 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1556 microversion: 2.1 time: 0.171549 Sep 26 18:04:53.842601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 483/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:53 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:53.861540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:53.862056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:53.868399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.868895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.869463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.870167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.870632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.871414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.914312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:53.914937 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:53.921008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.921553 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.922641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.923355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.923811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.924243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.951872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-241c9375-94a8-4a6e-af40-61574ac6a702 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094889 Sep 26 18:04:53.952534 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 523/1006] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 18:04:53 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:54.064018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:54.074663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:54.076628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:54.078042 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1710cb68-7d93-4061-bd38-c92eed3fd733 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1743 microversion: 2.20 time: 0.167695 Sep 26 18:04:54.078968 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 484/1007] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:53 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:54.965998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:54.968607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:54.975026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:54.975617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:54.976151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:54.976919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:54.977502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:54.978017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.010769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-81bc088a-545e-4db9-a4f1-90c41f09c4e1 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Sep 26 18:04:55.011554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 524/1008] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:04:54 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:55.023993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:55.024542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:55.032546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.033036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.033712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.034410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.035150 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.035748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.052077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f882295-9a3c-488b-af76-a40c3a07fdce", "tag": "3b139773-6d90-4d3c-bcb6-50875aa43976"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:55.061705 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.062199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.062695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.072173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-460caf5f-34a8-448d-8198-971f34c5103d tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f" status: 200 len: 194 microversion: 2.1 time: 0.052750 Sep 26 18:04:55.073477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 485/1009] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 18:04:55 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:55.075158 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] Creating event network-changed:3b139773-6d90-4d3c-bcb6-50875aa43976 for instance 0f882295-9a3c-488b-af76-a40c3a07fdce on hv-cinder-85931 Sep 26 18:04:55.080528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-fe91db47-0f63-4e6f-bc29-9ed008fcf685 req-50c2b133-60e2-4fa1-b382-aff1db3cb584 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034133 Sep 26 18:04:55.081678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 525/1010] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:55.112267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:55.112984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:55.119413 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.119969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.120410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.126252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.126252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.126252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.335233 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:55.346576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:55.348124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:55.349477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-62e1e350-1087-425d-a7d6-471d41dc3ee4 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1743 microversion: 2.20 time: 0.241649 Sep 26 18:04:55.350136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 486/1011] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:55 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1743 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:56.248778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:56.261721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.262283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.262787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.279010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] Creating event network-vif-plugged:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:04:56.285035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-c150a203-15f7-44e4-88d8-0c90335366d9 req-a8eaaad3-58cb-42f2-87a1-7bf8cf8cbb78 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040295 Sep 26 18:04:56.285674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 526/1012] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:56.376477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:56.382070 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:56.386848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.387551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.388103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.389074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.389816 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.390351 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.567867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:56.579260 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:56.581910 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:56.583934 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-91982925-553d-40d8-a5b4-4aa26ca240ff tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.212738 Sep 26 18:04:56.585038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 487/1013] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:56 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:56.845940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8963ab9-0288-4115-883d-6d70d8da54b7"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:56.849109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:56.856267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.856746 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.857435 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.858166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.858615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.859071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:57.619234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:57.619944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:57.622629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:57.628118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:57.633569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:57.636988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:57.636988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:57.636988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:57.636988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:57.758969 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fd344020-13ce-4d8f-840a-7a149a12fb34 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "POST /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920488 Sep 26 18:04:57.759991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 527/1014] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:04:56 2022] POST /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 194 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:57.856417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:57.866163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:57.867766 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:57.869195 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-38c5a0d1-5c7c-4999-9d84-da61cc4c6807 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.253991 Sep 26 18:04:57.869949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 488/1015] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:57 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:04:58.899411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:58.900280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:58.908116 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.911223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.911223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:58.911223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.911223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.911607 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:59.050208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:59.059358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:59.061082 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:59.062887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ec050b03-52c3-498a-96dd-66ed1eb91d5e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.167469 Sep 26 18:04:59.077303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 528/1016] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:04:58 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:00.091077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:00.091716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:00.098776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.099267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.099707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.100405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.100860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.101319 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.240149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:00.248373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:00.250046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:00.251454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2e0bb062-756c-4008-bb21-adb089cb8e7d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.164248 Sep 26 18:05:00.252006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 489/1017] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:00 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:01.128000 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1882480228", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-327912498", "security_groups": [{"name": "tempest-secgroup-smoke-1386146496"}], "networks": [{"uuid": "413a4d55-9af5-4efc-b2bc-1ccfe72e9c6b"}], "block_device_mapping_v2": [{"uuid": "70cc9cb4-5ddc-4ed5-b713-e18a58b4a6dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:01.153438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:01.264323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] validate_networks() for [('413a4d55-9af5-4efc-b2bc-1ccfe72e9c6b', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:01.279598 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:01.280355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:01.294297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.295050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.295643 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.296535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.297147 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.298341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.507581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:01.518859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:01.520959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:01.522846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-54d32b87-8930-4508-b698-cbc3b13c4dc9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.247935 Sep 26 18:05:01.541331 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 490/1018] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:01 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:01.805200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:01.805914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:01.806318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:01.806730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:01.807229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:01.822375 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.823635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.825790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.826934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.835908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.836609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.894653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Getting quotas for project 50b90dee570a4fd4bb2c5dafcfcd3c6c. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:01.902103 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Getting quotas for user ad574850851d48f29cdb17bb26149c30 and project 50b90dee570a4fd4bb2c5dafcfcd3c6c. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:02.022064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:02.024753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70cc9cb4-5ddc-4ed5-b713-e18a58b4a6dc',volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:02.551857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:02.552472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:02.552857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-498d5b6d-5703-444c-bef3-9a15be285a3a tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.430223 Sep 26 18:05:02.554237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 529/1019] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:05:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:05:02.561060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:02.561060 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:02.561543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:02.562276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:02.562739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:02.563203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:02.569606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6c97f077-7c86-4049-af2d-4d2cf852a9df tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:02.572716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6c97f077-7c86-4049-af2d-4d2cf852a9df tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:02.597670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:02.689127 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6c97f077-7c86-4049-af2d-4d2cf852a9df tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:02.698073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6c97f077-7c86-4049-af2d-4d2cf852a9df tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1088 microversion: 2.1 time: 0.134526 Sep 26 18:05:02.698663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 530/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:02 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1088 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:02.774626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:02.786360 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:02.787866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:02.789030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-42068e25-9b7f-4976-ae9e-63c44e5c36b2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.241003 Sep 26 18:05:02.801460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 491/1021] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:02 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:03.724056 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dc88a7a7-dc68-4325-ab1c-554fc1c562cb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:03.724575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dc88a7a7-dc68-4325-ab1c-554fc1c562cb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:03.778137 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-dc88a7a7-dc68-4325-ab1c-554fc1c562cb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.786350 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dc88a7a7-dc68-4325-ab1c-554fc1c562cb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1088 microversion: 2.1 time: 0.066747 Sep 26 18:05:03.786986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 531/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:03 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:03.815086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:03.815825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:03.822630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:03.823193 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:03.823696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.824458 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:03.825121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:03.825583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.976756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.984757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.986324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.987529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dd6a4142-defc-43b3-b6d0-910566d4e58b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.176720 Sep 26 18:05:03.988092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 492/1023] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:03 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:04.811289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:04.812144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:04.824762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.825651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.826504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.827357 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.828038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.828983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.897781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:04.907023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f217fd46-98da-43b9-9f53-61ad5676219f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1138 microversion: 2.1 time: 0.100721 Sep 26 18:05:04.907898 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 532/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:04 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1138 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:05.014089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:05.014662 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:05.025190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.025967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.026406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.027125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.027581 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.028011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.180129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:05.189027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:05.190797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:05.192145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fa2a0856-b4f1-4514-b78c-7c7942cebcf9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.182606 Sep 26 18:05:05.192700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 493/1025] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:05 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:05.929790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:05.930410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:05.937151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.937679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.938145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.938847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.939329 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.940059 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.003579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:06.014087 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d4ca0ce0-ce2a-4d8a-a4fa-6e84a93dd38c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1130 microversion: 2.1 time: 0.088235 Sep 26 18:05:06.025244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 533/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:05 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1130 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:06.218000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.218729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.230846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.230846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.230846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.231232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.231982 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.232629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.408264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:06.419814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:06.436824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:06.438580 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3e85f59f-fcad-4c75-8667-3a8446c3bf66 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.224713 Sep 26 18:05:06.440421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 494/1027] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:06.562452 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.565478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.572517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.573007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.573651 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.574409 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.574871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.575303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.626141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-58823c9b-0d88-407d-b10c-57426f523093 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068880 Sep 26 18:05:06.627129 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 534/1028] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:06.786594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.787098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.800190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.800680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.803265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.804170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.805925 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.806542 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.847184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-82017ada-47da-4e4e-bdc7-b8687cb8fedf tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f" status: 200 len: 194 microversion: 2.1 time: 0.070608 Sep 26 18:05:06.847859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 495/1029] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:06.859381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.860740 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.867128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.867872 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.868337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.869408 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.870027 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.870898 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.974873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'services' on Instance uuid d8fa9d97-e143-4954-bd53-12a953f8c78b {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:07.043621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:07.044591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:07.060313 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:07.061686 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:07.062373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:07.063979 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:07.064621 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:07.065345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:07.254394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:07.254394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6f5cbd1f-8c2d-41b2-9335-882a27468d04 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1194 microversion: 2.1 time: 0.199386 Sep 26 18:05:07.254394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 496/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:07 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1194 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:07.470243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:07.471031 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:07.478148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:07.478651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:07.482805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:07.482805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:07.482805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:07.482805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:07.513805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8c7c2e0c-2bc1-4d34-bd88-c5d6375910a5 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f" status: 202 len: 0 microversion: 2.1 time: 0.658572 Sep 26 18:05:07.518180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 535/1031] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:05:06 2022] DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/4269ec4b-a2b8-4b9d-8bc2-c7f811908d9f => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:05:07.804066 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:07.809941 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:07.811850 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:07.813303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-15a69021-d574-4704-b9e5-a1bdbf286587 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.347654 Sep 26 18:05:07.814834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 497/1032] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:07 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:08.264932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:08.266618 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:08.278098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.279066 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.279791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.280779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.281345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.282167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.307925 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:08.806664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:08.819828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5abb6365-2a55-40c2-ade8-bed39ff68d42 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1272 microversion: 2.1 time: 0.556120 Sep 26 18:05:08.819828 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 536/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:08 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:08.840157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:08.840783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:08.847794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.848317 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.848755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.849513 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.849975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.850411 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.991326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:09.001121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:09.002617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:09.003800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-341ad871-1b1f-4071-b94f-46bebf5b562a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1738 microversion: 2.20 time: 0.167856 Sep 26 18:05:09.004526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 498/1034] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:08 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:09.839976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:09.840627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:09.847117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.847632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.848070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:09.848764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.849246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.849773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.028796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:10.029460 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:10.050711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.051494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.052098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.052990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.053880 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.054498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.080567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:10.089761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aac7f60d-0e09-4960-b0f4-a32997e923c7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.253514 Sep 26 18:05:10.098011 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 537/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:09 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:10.280470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:10.291846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:10.297808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:10.298749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9da7e968-7300-43e7-a710-7931b2230cc2 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1720 microversion: 2.20 time: 0.272481 Sep 26 18:05:10.300341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 499/1036] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:10 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:10.449118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:10.464038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.465135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.465938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.481394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] Creating event network-changed:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:05:10.488891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-79fdd988-0394-414c-90ed-db2024c62bfd req-476efdeb-8b68-4dce-af5a-5a6ac7ab5f81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044727 Sep 26 18:05:10.490511 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 538/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:10.817563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:10.818064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:10.824055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.824526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.824964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.825701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.826164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.826598 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.856855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1e9e99fa-bb2c-4336-85b2-130610e3705c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/c8963ab9-0288-4115-883d-6d70d8da54b7" status: 200 len: 194 microversion: 2.1 time: 0.043279 Sep 26 18:05:10.860588 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 500/1038] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 18:05:10 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/c8963ab9-0288-4115-883d-6d70d8da54b7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:10.871282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:10.871904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:10.878309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.878788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.879217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.879910 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.880362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.880785 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.962063 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'services' on Instance uuid d8fa9d97-e143-4954-bd53-12a953f8c78b {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:11.113484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:11.114109 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:11.120446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:11.124292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:11.124292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:11.124292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:11.124292 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:11.124657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:11.256431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.264358 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-17612036-a2ae-42f3-8e14-273b57729639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.154779 Sep 26 18:05:11.268467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 501/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:11 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:11.301165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-63068a7f-46ca-4e4c-a5b3-a7e7c6c813f8 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/c8963ab9-0288-4115-883d-6d70d8da54b7" status: 202 len: 0 microversion: 2.1 time: 0.434466 Sep 26 18:05:11.304246 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 539/1040] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:05:10 2022] DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments/c8963ab9-0288-4115-883d-6d70d8da54b7 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:05:11.325185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:11.325854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:11.332803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:11.338800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:11.338800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:11.338800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:11.338800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:11.339514 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:11.466803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.475238 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.476965 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.478170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-65750faa-c2f2-4fc8-b3da-848dcf53281f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1720 microversion: 2.20 time: 0.157558 Sep 26 18:05:11.478726 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 502/1041] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:11 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:12.287066 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:12.292796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:12.293875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:12.300479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.301201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.301671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.302416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.302890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.303308 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.505481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:12.506362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:12.517804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.519131 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.519927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.520926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.523034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.523664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.565975 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.576363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-efe3905e-b066-4437-9190-189a213930dc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.290377 Sep 26 18:05:12.577327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 540/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:12 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:12.704616 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.712942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.714420 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.715584 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3aedd171-5f48-404b-8ecf-81cadf1e6531 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1720 microversion: 2.20 time: 0.215593 Sep 26 18:05:12.716120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 503/1043] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:12 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:13.594316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.597021 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.602155 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.603362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.604170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.604663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.605104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.605832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.606457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.607186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.609849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.613190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.613190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.613190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.613190 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.613658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.640402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a0e74887-5fe2-4e97-9c01-43fdb5816594 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050107 Sep 26 18:05:13.641871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 541/1044] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:05:13.741243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.741962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.748209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.748778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.749313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.750100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.750811 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.751937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.763858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:13.763858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5ca61746-ebc6-4e23-8dca-fe1d20a26c2d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.165467 Sep 26 18:05:13.763858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 504/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:13.776034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.778526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.784538 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.785054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.785194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=10 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:13.785504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.786205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.786664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.787098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.821681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7c661a87-0205-4e7a-a874-a788e319714c tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050732 Sep 26 18:05:13.822617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 505/1046] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 18:05:13.888935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.889826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.898790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.899293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.902255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.902255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.902255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.902255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.905023 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:13.914013 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:13.915540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:13.916753 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5d850827-0afb-4ed2-9fb9-94096c2ff204 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1663 microversion: 2.20 time: 0.179778 Sep 26 18:05:13.917333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 542/1047] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:13.930741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:05:13.944813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af9353fb-2a9e-4117-84f5-07a9a0e442a4"}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:13.948193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.955792 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.956544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.957138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.958393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.959010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.959589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.073384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:14.344188 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-335deb6a-ad8c-4835-829a-a60c7c2a2955 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 204 len: 0 microversion: 2.1 time: 0.458312 Sep 26 18:05:14.345717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 506/1048] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:13 2022] DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:05:14.352846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "name": "network-vif-unplugged", "status": "completed", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:14.364497 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.364963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.365428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.377620 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.compute.server_external_events [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] Unable to find a host for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c. Dropping event network-vif-unplugged {{(pid=132948) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 18:05:14.378499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-21275be4-e2fb-45ef-8275-95625b189fd2 req-5ab95872-23d4-4a91-a0d8-3e36798b8c19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029776 Sep 26 18:05:14.379255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 507/1049] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 18:05:14.389606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:14.389606 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:14.390627 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.391111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.392074 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.392767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.393216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.393664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.528665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:14.537048 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-040648d5-72a3-4bf7-8113-3ab20794ac60 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1673 microversion: 2.1 time: 0.156650 Sep 26 18:05:14.537641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 508/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:14 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:14.789867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:14.790842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:14.803217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.803723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.804446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.805188 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.805729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.806173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.945972 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:14.953512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d519f665-6ad1-4777-b025-fad91b485b7d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.171002 Sep 26 18:05:14.954092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 509/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:14 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:15.164539 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dd7e756d-8f27-410d-ac3a-86f23c8d8c64 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.223670 Sep 26 18:05:15.165159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 543/1052] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 18:05:13 2022] POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments => generated 188 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:05:15.290613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:15.291037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:15.297558 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.298046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.298484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.299799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.300256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.300708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.560018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:15.560574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:15.566498 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.566986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.567421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.568875 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.569470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.569954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.705733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:15.713433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cd991279-7751-4cbd-961b-389b006419cc tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1673 microversion: 2.1 time: 0.157365 Sep 26 18:05:15.713996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 544/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:15 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:15.977681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:15.978289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:15.984235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.984825 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.985157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.985880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.986333 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.986789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.090078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0166f69f-ed89-44e3-932c-78063f447414 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments/af9353fb-2a9e-4117-84f5-07a9a0e442a4" status: 202 len: 0 microversion: 2.20 time: 0.803456 Sep 26 18:05:16.090817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 510/1054] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 18:05:15 2022] DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments/af9353fb-2a9e-4117-84f5-07a9a0e442a4 => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:05:16.117766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:16.125569 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bff8f871-409f-43cd-ae50-e915f3186377 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.151680 Sep 26 18:05:16.130761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 545/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:15 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:16.152418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:16.153016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:16.160336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.160831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.161299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.162012 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.162496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.162920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.192523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132948) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:05:16.476200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3b2ee544-de79-4ed7-97df-980f008b4966 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/action" status: 202 len: 0 microversion: 2.20 time: 0.327962 Sep 26 18:05:16.477299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 511/1056] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 18:05:16 2022] POST /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:05:16.485662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:16.486573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:16.492624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.493388 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.493833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.494568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.495031 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.495488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.633446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:16.641674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:16.643547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:16.644320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-782c07da-de14-4f39-9db8-e3e204c2426d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1671 microversion: 2.20 time: 0.162671 Sep 26 18:05:16.644892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 546/1057] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:16 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:16.737111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:16.737688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:16.743744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.744234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.744676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.745399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.745863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.746297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.996912 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:17.004943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3ee172e2-b64c-4c31-abdd-663e1e951701 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1673 microversion: 2.1 time: 0.272514 Sep 26 18:05:17.009387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 512/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:16 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:17.162389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:17.164797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:17.173404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.174039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.174627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.175566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.176327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.176852 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.396347 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:17.404737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-26b682de-384f-4531-8cd9-f9482c2a202e tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.256762 Sep 26 18:05:17.405749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 547/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:17 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:17.671666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:17.672352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:17.678513 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.678993 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.679626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.680329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.680783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.681211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.869937 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:17.878682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:17.880142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:17.881340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6705d7f5-fadb-4be5-ba46-6bcee8b97669 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1671 microversion: 2.20 time: 0.214747 Sep 26 18:05:17.881901 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 513/1060] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:17 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1671 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:17.986836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fa9d97-e143-4954-bd53-12a953f8c78b", "name": "network-vif-deleted", "tag": "1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:17.997506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.998299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.998405 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.010968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] Creating event network-vif-deleted:1aa3c1c6-fe19-4960-9be4-33f0ca41b4b7 for instance d8fa9d97-e143-4954-bd53-12a953f8c78b on hv-cinder-85931 Sep 26 18:05:18.016419 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-217fc8da-b658-471f-82b7-e48a76e87d5e req-caecc31e-25e0-4369-9521-bea508f58535 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033451 Sep 26 18:05:18.017019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 548/1061] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:18.028945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:18.033121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:18.037346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.037915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.038600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.039375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.039924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.040601 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.122396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:18.132685 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b5eb2196-7ca6-434c-8b1c-eccf9658cad4 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1606 microversion: 2.1 time: 0.108049 Sep 26 18:05:18.147035 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 514/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:18 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1606 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:18.431387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:18.432277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:18.438731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.440036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.440036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.440420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.440882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.441339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.615946 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:18.624414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a6558ebc-377c-445b-b63c-03e25b0c4fdb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.197866 Sep 26 18:05:18.625018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 549/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:18 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:18.911000 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:18.911642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:18.918613 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.919538 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.920380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.921110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.921617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.922079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.132443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.141429 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.143464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.144659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4c076d8b-65a3-4769-a964-39a5ea06a9e5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.238435 Sep 26 18:05:19.145300 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 515/1064] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:18 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:19.164107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:19.164733 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:19.177646 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.178180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.181502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.181502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.181502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.181502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.214954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.215443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.215905 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.216344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid d8fa9d97-e143-4954-bd53-12a953f8c78b {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:19.219194 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:19.257178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.264714 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-197f23ab-4b1a-498d-8016-252eb6c14491 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1327 microversion: 2.1 time: 0.108249 Sep 26 18:05:19.265300 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 550/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:19 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:19.647464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:19.648169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:19.654491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.654971 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.655405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.656090 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.656539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.656959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.872324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.880830 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ba400b42-013e-4989-a45e-b366f507dfcc tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.237151 Sep 26 18:05:19.881583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 516/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:19 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:20.170338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.171014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.178863 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.179349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.179790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.180494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.180952 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.181437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.288939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.289589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.296152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.296645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.297098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.297815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.298276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.299250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.331217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.331483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.331924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.335632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lazy-loading 'fault' on Instance uuid d8fa9d97-e143-4954-bd53-12a953f8c78b {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:20.404422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020860051d44960a924b62989a7988b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04dd3fdb6ab4fddbd9f68b60cac3568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.412919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1716a8e7-93c3-4226-b369-efefd9bdd6e3 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 200 len: 1327 microversion: 2.1 time: 0.127639 Sep 26 18:05:20.413717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 517/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:20.442728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.450972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.452412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.453637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f0e3edcd-feee-448f-859d-e2c6e423d02c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.287189 Sep 26 18:05:20.454201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 551/1068] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:20.904440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.905146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.911605 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.912084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.912694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.913488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.913948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.914376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.304894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.312499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b5f2483c-4ba3-4857-8f82-37d4597aca5c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.412200 Sep 26 18:05:21.313063 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 518/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:21.436305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:21.436926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:21.443694 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.444760 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.445213 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.446140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.446613 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.447529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.465514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b HTTP/1.1 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:05:21.467548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:21.469421 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'd8fa9d97-e143-4954-bd53-12a953f8c78b'} Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:21.470994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:21.472781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:21.474010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:21.474010 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4096652a-d397-43ac-81cc-275591bd1aba tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 404 len: 111 microversion: 2.1 time: 0.037108 Sep 26 18:05:21.474548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 552/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:21 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:21.478794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3b9a1a87-b32d-4cd5-8238-a5518fd1ad33 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '.version_select at 0x7ff9820179d0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:21.480305 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:21.480943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:21.489044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.489581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.490035 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.490810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.491451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.492046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.629444 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3b9a1a87-b32d-4cd5-8238-a5518fd1ad33 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351733989" status: 202 len: 0 microversion: 2.1 time: 0.154384 Sep 26 18:05:21.633449 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 519/1071] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 18:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351733989 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:05:21.657416 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.680253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.682154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.683601 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5ac393dc-abe6-4373-8f3f-140b584f5e6f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.208022 Sep 26 18:05:21.684541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 553/1072] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:21 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:22.336639 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:22.337459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:22.352241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.352749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.353198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.354033 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.354682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.355293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.640807 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.659165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9f89f0f6-23a3-49e3-ab55-47a6a008c200 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.326881 Sep 26 18:05:22.684568 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 520/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:22 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:22.712451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:22.713175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:22.720141 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.721348 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.726944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.728154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.728646 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.729090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.891387 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.900130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.901978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.903253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-52a00abf-cc29-4e5e-b59b-a0ec12309713 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.194986 Sep 26 18:05:22.903809 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 554/1074] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:22 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:23.699117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:23.699671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:23.706302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.706791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.707232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.708064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.708524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.708947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.711801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:23.866817 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:23.875897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-176e346d-8f19-463c-8ded-f7c7e0f5e9d3 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.180713 Sep 26 18:05:23.877173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 521/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:23 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:23.931930 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:23.932739 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:23.940517 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.941009 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.941480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.942191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.942647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.943083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.099827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:24.109471 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:24.111067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:24.112375 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4c2a7ff9-748f-46c8-a9f5-a6c36c8dd9b8 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.186406 Sep 26 18:05:24.115426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 555/1076] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:23 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:24.471096 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "name": "network-vif-plugged", "status": "completed", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:24.482376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.482873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.483340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.494339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] Creating event network-vif-plugged:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:05:24.499391 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-26df3d36-d6dc-43c4-a1b7-ddf7a3f08723 req-1be88c38-ae38-4668-b425-ea49bde3056c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033780 Sep 26 18:05:24.500002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 522/1077] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:24.899640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:24.900463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:24.906659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.908524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.909193 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.910142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.911289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.912707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.060831 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.068956 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-bb067cc0-1cc5-4b7c-b460-799116597ae7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.173290 Sep 26 18:05:25.069588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 556/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:24 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:25.139708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:25.140493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:25.153121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.154002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.154584 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.155734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.156265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.157110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.307926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.317387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.318841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.320357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-1add304c-1142-4a63-ab9d-235641ac377f tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.186157 Sep 26 18:05:25.320973 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 523/1079] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:25 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:25.434286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:25.434788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:25.441685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.442175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.442630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.443313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.443766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.444188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.470050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b HTTP/1.1 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:05:25.471655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.473261 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'd8fa9d97-e143-4954-bd53-12a953f8c78b'} Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:25.474197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.475678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.477053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:25.478215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f1afaa4a-d638-4868-9af3-f3a9dc13e5d2 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 404 len: 111 microversion: 2.1 time: 0.046832 Sep 26 18:05:25.478801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 557/1080] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:25 2022] DELETE /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:25.487267 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:25.487884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: d8fa9d97-e143-4954-bd53-12a953f8c78b] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:25.493987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.494478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.494919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.495653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.496112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.496541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.510660 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b HTTP/1.1 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:05:25.512443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.513773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'd8fa9d97-e143-4954-bd53-12a953f8c78b'} Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:25.514664 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. Sep 26 18:05:25.515846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:25.517030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance d8fa9d97-e143-4954-bd53-12a953f8c78b could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:25.517030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-41f95da8-9148-4b8b-962c-4d33ae882938 tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b" status: 404 len: 111 microversion: 2.1 time: 0.030684 Sep 26 18:05:25.517030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 524/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:25 2022] GET /compute/v2.1/servers/d8fa9d97-e143-4954-bd53-12a953f8c78b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:26.092316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.092934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.100310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.100800 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.101265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.102019 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.102477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.102909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.246248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.255364 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ac50e116-f26a-4c63-9ce1-765c39f3970c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.166806 Sep 26 18:05:26.256089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 558/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:26 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:26.347282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.348204 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.355164 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.357334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.357334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.357334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.357700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.357801 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.497543 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.506262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.507712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.508889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-df4cfa2b-676d-4bdc-aaed-cc6113862b84 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.165632 Sep 26 18:05:26.509477 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 525/1083] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:26 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:26.811426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.812146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.819302 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.819787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.820400 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.821343 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.821805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.822236 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.839489 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 HTTP/1.1 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:05:26.841565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.843167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'b533dfe6-6158-43f2-961d-f50d398f79d6'} Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:26.843904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.845100 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.846466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:26.846466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7ba385a6-d00d-4e25-815b-a493a9c8c84e tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 404 len: 111 microversion: 2.1 time: 0.035423 Sep 26 18:05:26.846466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 559/1084] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:26 2022] DELETE /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:26.851520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.852158 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] [instance: b533dfe6-6158-43f2-961d-f50d398f79d6] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.859814 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.860396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.860945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.861874 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.862299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.862883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.878818 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] HTTP exception thrown: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Request method failure captured: Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 HTTP/1.1 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegQvo0-Rx8W5AR-oazb_zlNGdHwC0PMkOy6EqsSfFW66zRvErhCra8IfwhvbD3kAovvM_4H0Qq3vdtB679ARhfqYhCwu3r3OFegsi1mgtsrXhUEUa_KRVthTL4d90UQV9b8_TvBaB4V6_bane45n7BpI8K9rly-42G4oPCAOoiF3zA Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:05:26.880376 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b04dd3fdb6ab4fddbd9f68b60cac3568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b04dd3fdb6ab4fddbd9f68b60cac3568"}]}] Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: b04dd3fdb6ab4fddbd9f68b60cac3568 Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeTestJSON-848120469 Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 2020860051d44960a924b62989a7988b Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeTestJSON-848120469-project Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.881768 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'b533dfe6-6158-43f2-961d-f50d398f79d6'} Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:26.882734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. Sep 26 18:05:26.883922 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:05:26.885026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] Returning 404 to user: Instance b533dfe6-6158-43f2-961d-f50d398f79d6 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:26.885026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e6cec6e5-21b7-4dfb-9d11-f6c4cb37d2cb tempest-AttachVolumeTestJSON-848120469 tempest-AttachVolumeTestJSON-848120469-project] 10.222.0.49 "GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6" status: 404 len: 111 microversion: 2.1 time: 0.034285 Sep 26 18:05:26.886176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 526/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:26 2022] GET /compute/v2.1/servers/b533dfe6-6158-43f2-961d-f50d398f79d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:27.280588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:27.282215 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:27.292692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.293182 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.293659 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.294558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.295015 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.295513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.514622 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.525404 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b0e6036c-329e-4e50-9e5a-a7098421d89c tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.248348 Sep 26 18:05:27.526509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 560/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:27 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:27.549108 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:27.550492 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:27.569499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.570262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.570875 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.571747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.572375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.572799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.737192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.750623 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.753249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.754779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d6cac636-8b13-45b1-b7c8-3a10c38f9984 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.210235 Sep 26 18:05:27.755636 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 527/1087] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:27 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:28.552677 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:28.555448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:28.564352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.567649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.570988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.572030 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.573142 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.575338 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.781502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:28.782124 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:28.788457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:28.794861 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.795362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.795810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.796578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.797036 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.797908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.881493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:28.898179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9856eb90-4e38-4ff5-ad01-a63dae51cb36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.349884 Sep 26 18:05:28.898794 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 561/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:28 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:29.085719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:29.096468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:29.097970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:29.103980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-efa8a1c2-74c6-4615-9b87-0d3d8c2c1e91 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.322042 Sep 26 18:05:29.104869 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 528/1089] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:28 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:29.925574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:29.926214 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:29.936832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.937366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.937803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:29.938508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.939455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.939883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.128656 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.131329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:30.133666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:30.138399 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f962d721-1cac-452c-a009-4446e80606de tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.216774 Sep 26 18:05:30.139615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 562/1090] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:29 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:30.142909 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.153312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.153312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.153312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.153312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.154450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.506557 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.520250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.523659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.525663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b32b0b53-fb2d-4fc7-81b1-781c2d563d45 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.397822 Sep 26 18:05:30.528611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 529/1091] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:30 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:31.167816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:31.171316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:31.175692 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.176173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.176614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.177352 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.177981 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.178406 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.316585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:31.333897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a51f615a-7fba-4f2f-a313-9334d0034394 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.160741 Sep 26 18:05:31.333897 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 563/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:31 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:31.558884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:31.562225 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:31.569428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.570006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.570512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.572001 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.572614 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.573191 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.738136 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:31.746432 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:31.747883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:31.749043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cb746df6-ec01-44ec-8163-353ab3b11d97 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.197318 Sep 26 18:05:31.749645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 530/1093] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:31 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:32.348703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:32.349378 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:32.351701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:32.356332 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.356845 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.357294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.357988 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.358438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.358859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.488769 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.496570 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2604b16b-ce8d-4dd6-b0e9-e0988a0e3545 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.152444 Sep 26 18:05:32.497145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 564/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:32 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:32.774480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:32.775366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:32.781776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.782269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.783227 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.783923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.784379 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.784815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.936161 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.945923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.947618 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.948797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6bdf4977-9454-401f-8927-4eb667aba1f1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.178222 Sep 26 18:05:32.950008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 531/1095] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:32 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:33.520993 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:33.521922 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:33.529715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.534124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.534612 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.538267 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.538757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.539241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.681545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:33.691735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3725e05e-2c71-464b-a83a-9a52fed88d30 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.175684 Sep 26 18:05:33.692441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 565/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:33 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:33.974617 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:33.975472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:33.981795 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.982952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.983498 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.984710 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.984825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.985337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.174046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.182266 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.183729 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.185244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-97a757ba-05c4-4d02-9d01-66c204cc198a tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.214323 Sep 26 18:05:34.185757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 532/1097] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:33 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:34.721174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:34.721174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:34.723549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:34.723784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:34.724243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.724900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:34.725869 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:34.726287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.863400 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.872185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0a1b78b2-e14f-4e1e-a023-b1a2d5234846 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1260 microversion: 2.1 time: 0.160895 Sep 26 18:05:34.872776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 566/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:34 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:35.212312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:35.213211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:35.220705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.221991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.221991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.222596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.223051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.223641 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.354776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:35.362996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:35.364457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:35.365649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-130cee9b-4d0b-4ebb-b71c-5405450983a1 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.157678 Sep 26 18:05:35.366210 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 533/1099] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:35 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:35.895590 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:35.896256 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:35.904076 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.904566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.905006 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.905767 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.906229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.906674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.066951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.075490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0f243c8a-1218-4274-9556-f10310af94d5 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1442 microversion: 2.1 time: 0.183817 Sep 26 18:05:36.076077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 567/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:35 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1442 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:36.103763 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:36.104380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:36.110894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.111377 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.111811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.112540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.113024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.113491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.278198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.286836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-2db33bbb-8878-4eae-85ee-feffaaa84a36 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1442 microversion: 2.1 time: 0.187269 Sep 26 18:05:36.287530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 534/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:36 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1442 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:36.438599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:36.438599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:36.438599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.438599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.439818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.439818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.439818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.439818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.481716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:36.493198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.493709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.494165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.515403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] Creating event network-vif-plugged:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:05:36.521634 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-751eaf78-4dc0-4a51-a127-881834c1091d req-2505f1b6-4005-4e3d-bfda-845b209bad7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044605 Sep 26 18:05:36.522472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 535/1102] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:36.599718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.608118 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.609971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.611313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-04f5fbfe-8490-4293-9268-11d0b4c74be0 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.212984 Sep 26 18:05:36.611866 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 568/1103] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:36 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:37.638354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:37.639608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:37.647264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:37.647758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:37.648405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:37.649166 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:37.649663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:37.650344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:37.791779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:37.801889 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:37.803575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:37.804838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-02880a2e-2029-4254-b608-459772591f2b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.171595 Sep 26 18:05:37.805651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 536/1104] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:37 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:38.830320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:38.831734 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:38.838887 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.841902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.841902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:38.841902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.841902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.842331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:38.860525 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=100 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:39.000693 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.008838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.010555 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.012235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-00960da1-6a15-4304-941a-ad5bfda06a16 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.186381 Sep 26 18:05:39.014140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 569/1105] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:38 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:39.281499 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:39.293596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:39.294454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:39.295099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.312894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] Creating event network-changed:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:05:39.321863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-a44ac320-1090-453d-a013-cfc9e76c7674 req-98efc534-c74b-4718-ab99-719876d96944 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041164 Sep 26 18:05:39.321863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 537/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:40.039886 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:40.041094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:40.047888 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.048418 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.048857 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.049583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.050029 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.050467 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.237037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.246723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.252779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.254442 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e7aa4841-99f6-48b4-8df8-40c6f64e955d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1729 microversion: 2.20 time: 0.218751 Sep 26 18:05:40.268637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 570/1107] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:40 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:41.282873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:41.283578 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:41.289756 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.290240 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.290679 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.291505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.291961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.292388 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.427487 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.435681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.437142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.438496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7699ccc5-585a-4977-8b8b-2a9e8fcd9c35 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1716 microversion: 2.20 time: 0.160620 Sep 26 18:05:41.439672 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 538/1108] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:41 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:50.571805 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:50.572423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:50.575040 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=13 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:50.575822 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=11 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:50.581202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.581716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.582164 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.582891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.583354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.583782 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.615846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-37f9a5cf-bd08-4db2-809e-d671ea3b0736 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/ips" status: 200 len: 148 microversion: 2.1 time: 0.047875 Sep 26 18:05:50.616470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 571/1109] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 18:05:50 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:54.401645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62610269-b002-4b30-a5a2-b3ff01c31304"}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:54.404084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.406431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=21 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:54.407610 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=87 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:54.412584 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.413114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.413603 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.414307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.414796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.415231 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.277595 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ef407301-8a7e-4ab1-9f11-f61e3fb734d3 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "POST /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879933 Sep 26 18:05:55.278218 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 539/1110] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 18:05:54 2022] POST /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:03.051205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:03.051846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:03.059469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.059950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.060411 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:03.061070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.061564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.062003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:03.143392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'services' on Instance uuid 0f882295-9a3c-488b-af76-a40c3a07fdce {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:03.415075 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-101ca399-2b3c-469c-adbf-3ea29b8de954 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments/62610269-b002-4b30-a5a2-b3ff01c31304" status: 202 len: 0 microversion: 2.1 time: 0.368088 Sep 26 18:06:03.415583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 572/1111] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 18:06:03 2022] DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments/62610269-b002-4b30-a5a2-b3ff01c31304 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:06:03.425525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:03.428007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:03.434431 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.434923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.435364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:03.436067 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.436549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.436983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:03.468387 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bf1f015e-f6ef-483f-b18d-009e70ce46bd tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048128 Sep 26 18:06:03.468948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 540/1112] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:06:03 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:04.482260 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:04.484614 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:04.491553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.492089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.492531 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.493253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.493737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.494155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.526115 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fff251d9-77e2-4221-8077-0c2475e40996 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048887 Sep 26 18:06:04.526833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 573/1113] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 18:06:04 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:06:04.590879 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:04.591399 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:04.598656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.599149 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.599596 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.600305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.600764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.601199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.628998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:06:04.964739 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8312626b-149a-4a7c-96f4-84ccdaf76b3a tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 204 len: 0 microversion: 2.1 time: 0.377443 Sep 26 18:06:04.968009 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 541/1114] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:04 2022] DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:06:04.974159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:04.974770 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:04.980644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.981123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.981596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.982276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.982735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.983160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.122653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:05.123742 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4db4c8a7-0824-4801-9410-86ec6c825301 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1680 microversion: 2.1 time: 0.153419 Sep 26 18:06:05.124363 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 574/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:04 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:06.147369 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:06.148090 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:06.154682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.155169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.155612 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.156337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.156828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.157323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.286666 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.294488 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7f11a71a-fcad-4ac0-8b73-348e0c9469ef tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1680 microversion: 2.1 time: 0.151439 Sep 26 18:06:06.295053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 542/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:06 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:07.318598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:07.319349 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:07.326221 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.326708 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.327155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.327859 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.328392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.328835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.836096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:07.844304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d1ba3d4c-1735-48af-934a-504e8ff3adc9 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1680 microversion: 2.1 time: 0.529686 Sep 26 18:06:07.845562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 575/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:07 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1680 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:08.334863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f882295-9a3c-488b-af76-a40c3a07fdce", "name": "network-vif-deleted", "tag": "3b139773-6d90-4d3c-bcb6-50875aa43976"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:08.345512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.346129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.346635 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.358893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] Creating event network-vif-deleted:3b139773-6d90-4d3c-bcb6-50875aa43976 for instance 0f882295-9a3c-488b-af76-a40c3a07fdce on hv-cinder-85931 Sep 26 18:06:08.364705 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-52ff1627-b15b-47e3-96ee-f536d6183c0e req-1475378f-5233-4f82-b2f5-59f9f9a62d42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033816 Sep 26 18:06:08.365280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 543/1118] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:08.869375 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:08.870102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:08.877577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.878068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.879147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.880045 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.880506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.880941 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.918515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.918954 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.919396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.919849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lazy-loading 'fault' on Instance uuid 0f882295-9a3c-488b-af76-a40c3a07fdce {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:08.961292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d46bbda38da4cf1804dee850217f11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a89f645645c5be0747fa7cc91bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.969205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5e9873ad-7be5-4181-9ca7-887796fb7f4e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 200 len: 1332 microversion: 2.1 time: 0.104973 Sep 26 18:06:08.970314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 576/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:08 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:09.994712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:09.995600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:10.003157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.003649 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.004093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.004796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.005282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.005716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.022021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce HTTP/1.1 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:10.026848 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:10.028657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '0f882295-9a3c-488b-af76-a40c3a07fdce'} Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:10.029779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:10.031418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:10.033810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:10.033810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8f7a38f9-1c75-4299-ac5d-e81a6075f1b7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 404 len: 111 microversion: 2.1 time: 0.034965 Sep 26 18:06:10.033810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 544/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:09 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:10.038483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-625634a3-f91b-4b72-957b-2981d355c606 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '.version_select at 0x7ff981e5ec10>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:10.187397 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-625634a3-f91b-4b72-957b-2981d355c606 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072428253" status: 202 len: 0 microversion: 2.1 time: 0.152744 Sep 26 18:06:10.188041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 577/1121] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 18:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072428253 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:06:12.388532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.389041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.395410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.395896 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.396341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.397034 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.397528 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.397963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.411838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce HTTP/1.1 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:12.413306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.414903 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '0f882295-9a3c-488b-af76-a40c3a07fdce'} Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:12.415727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.417175 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.418758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:12.418758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5c43fe7f-2298-481f-bed3-1d42cde8135e tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 404 len: 111 microversion: 2.1 time: 0.029969 Sep 26 18:06:12.418758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 545/1122] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:12 2022] DELETE /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:12.424293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.424934 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 0f882295-9a3c-488b-af76-a40c3a07fdce] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.431585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.432070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.432504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.433191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.433666 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.438944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.446920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce HTTP/1.1 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:12.448553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.450293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '0f882295-9a3c-488b-af76-a40c3a07fdce'} Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:12.451188 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. Sep 26 18:06:12.452720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:12.454083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 0f882295-9a3c-488b-af76-a40c3a07fdce could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:12.454083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-875db1a2-761f-4fb2-a11a-b477f8d4b1c7 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce" status: 404 len: 111 microversion: 2.1 time: 0.030646 Sep 26 18:06:12.454083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 578/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/0f882295-9a3c-488b-af76-a40c3a07fdce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:13.105172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-695493587", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "networks": [{"uuid": "f37f73d5-5123-4050-b2dd-1ab07f5e6540"}]}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:13.162117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] validate_networks() for [('f37f73d5-5123-4050-b2dd-1ab07f5e6540', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:06:13.502749 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:06:13.503352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:06:13.503642 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:06:13.504084 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:06:13.504520 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:06:13.513412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.513897 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.514338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.515073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.515533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.515964 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.534312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Getting quotas for project f9a05f1b4598419ab701bec55add1318. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:06:13.538410 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Getting quotas for user 3d349e5a507c425fab173cc785bd679a and project f9a05f1b4598419ab701bec55add1318. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:06:13.549434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:06:13.551831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:06:13.704203 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b0de62dc-3574-4bfe-8ba4-54e9f3f05819 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602300 Sep 26 18:06:13.710836 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 546/1124] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:06:13.717266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-68dda8b7-52b3-47ad-a1f3-3f3c7053f919 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.717663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-68dda8b7-52b3-47ad-a1f3-3f3c7053f919 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.743496 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.747286 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.755173 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.755680 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.756103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.756804 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.757276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.757707 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.772117 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae HTTP/1.1 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:13.773727 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.775418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '921f12a9-6f62-478f-a547-9a46350096ae'} Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:13.776288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.777608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.778824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:13.778824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bec24194-2916-4fcb-99a3-f048c71b11b4 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 404 len: 111 microversion: 2.1 time: 0.035675 Sep 26 18:06:13.778824 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 547/1125] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:13 2022] DELETE /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:13.787359 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.788021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 921f12a9-6f62-478f-a547-9a46350096ae] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.794322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.794876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.795508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.796428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.796805 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.797356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.799579 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-68dda8b7-52b3-47ad-a1f3-3f3c7053f919 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:13.806978 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-68dda8b7-52b3-47ad-a1f3-3f3c7053f919 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1213 microversion: 2.1 time: 0.094810 Sep 26 18:06:13.808299 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 579/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:13 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:13.812692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae HTTP/1.1 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:13.814363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.815713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '921f12a9-6f62-478f-a547-9a46350096ae'} Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:13.816483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. Sep 26 18:06:13.818078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.819169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 921f12a9-6f62-478f-a547-9a46350096ae could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:13.819169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-8611f1c0-d354-41f5-b45d-8519e7e61bb1 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae" status: 404 len: 111 microversion: 2.1 time: 0.032935 Sep 26 18:06:13.819890 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 548/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:13 2022] GET /compute/v2.1/servers/921f12a9-6f62-478f-a547-9a46350096ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:13.825983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.826475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.833836 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.834314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.834747 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.835435 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.835882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.836303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.849438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f HTTP/1.1 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:13.851186 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.852522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'ae9a9e8a-7083-4630-b3a3-f06226a6b58f'} Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:13.853674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.855199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.856892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:13.856892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-eb0c6b27-55a4-44ec-84c1-cdaabe295abc tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 404 len: 111 microversion: 2.1 time: 0.030429 Sep 26 18:06:13.856892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 580/1128] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:13 2022] DELETE /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:13.861490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.862470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: ae9a9e8a-7083-4630-b3a3-f06226a6b58f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.867987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.868462 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.868894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.869619 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.870069 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.871002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.884366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f HTTP/1.1 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:13.885905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.887481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'ae9a9e8a-7083-4630-b3a3-f06226a6b58f'} Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:13.888348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. Sep 26 18:06:13.889667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:13.890942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance ae9a9e8a-7083-4630-b3a3-f06226a6b58f could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:13.890942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-cfab6093-d152-4634-9f75-89fc1af8ba47 tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f" status: 404 len: 111 microversion: 2.1 time: 0.030212 Sep 26 18:06:13.890942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 549/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:13 2022] GET /compute/v2.1/servers/ae9a9e8a-7083-4630-b3a3-f06226a6b58f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:14.831297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-64124fde-8ce1-4d65-8ef7-8885997130d0 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:14.831936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-64124fde-8ce1-4d65-8ef7-8885997130d0 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:14.884168 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-64124fde-8ce1-4d65-8ef7-8885997130d0 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:14.892417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-64124fde-8ce1-4d65-8ef7-8885997130d0 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1213 microversion: 2.1 time: 0.065617 Sep 26 18:06:14.892971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 581/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:14 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:15.261746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:15.262234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:15.269373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.269895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.270329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.271024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.271471 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.271894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.287885 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 HTTP/1.1 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:15.289459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.291007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '158e230e-aa1a-4311-81fc-5815c8cf0f64'} Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:15.291855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.293217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.294566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:15.294566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f41d3884-2ac5-463a-b4d7-2b929742c6ab tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 404 len: 111 microversion: 2.1 time: 0.032911 Sep 26 18:06:15.294566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 550/1131] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:15 2022] DELETE /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:15.299826 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:15.303530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] [instance: 158e230e-aa1a-4311-81fc-5815c8cf0f64] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:15.306316 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.306835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.307278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.307962 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.308413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.308837 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.321899 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] HTTP exception thrown: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Request method failure captured: Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 HTTP/1.1 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegMYYXahZ5EB0c0L8wKLaoI3b1VEWr8fLrE64Jx9Wy24u1mAK8ARgxVgci8B1_kbpdnGIg7brWSos-QVeJdVhxn7q8b1946fOAJEepWv4_C4AlYjRLyc0yKSH-xdL-1x2L96b-KrII3tZlTYLTM8HLVdptW0FbFozuKHvEo1bagRAI Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:15.323413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc91a89f645645c5be0747fa7cc91bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc91a89f645645c5be0747fa7cc91bb6"}]}] Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: cc91a89f645645c5be0747fa7cc91bb6 Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703369248 Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 4d46bbda38da4cf1804dee850217f11d Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeNegativeTest-1703369248-project Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.324827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '158e230e-aa1a-4311-81fc-5815c8cf0f64'} Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:15.329474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. Sep 26 18:06:15.330928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:15.332662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] Returning 404 to user: Instance 158e230e-aa1a-4311-81fc-5815c8cf0f64 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:15.332662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-366c6de3-dae7-4421-a765-fe490a6bf6ce tempest-AttachVolumeNegativeTest-1703369248 tempest-AttachVolumeNegativeTest-1703369248-project] 10.222.0.49 "GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64" status: 404 len: 111 microversion: 2.1 time: 0.028889 Sep 26 18:06:15.332662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 582/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:15 2022] GET /compute/v2.1/servers/158e230e-aa1a-4311-81fc-5815c8cf0f64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:15.915152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:15.915774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:15.921842 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.922841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.923290 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.923985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.924446 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.924906 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.986025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:15.995165 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5be97140-e16a-4f1d-a1fc-ed8c85924672 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1265 microversion: 2.1 time: 0.083864 Sep 26 18:06:15.995741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 551/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:15 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:17.020245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:17.021037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:17.028684 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.029459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.030169 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:17.031092 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.032550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.033354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:17.128627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:17.140365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e69ad620-5f9a-4a9d-8e66-ffe8dc682275 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1271 microversion: 2.1 time: 0.123836 Sep 26 18:06:17.141673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 583/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:17 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:18.163651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:18.164863 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:18.171375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:18.171866 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:18.173257 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.173996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:18.174511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:18.174913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.459868 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:18.479071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4b1508ea-09f4-4fb9-a759-b80feabb3436 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.310437 Sep 26 18:06:18.479071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 552/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:18 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:18.642297 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88ca258-66e6-42ef-8518-5bf2c5691271", "tag": "5696c8c8-93a9-4883-bc51-f80cb0320f31"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:18.662430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:18.663081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:18.663655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.675992 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] Creating event network-changed:5696c8c8-93a9-4883-bc51-f80cb0320f31 for instance b88ca258-66e6-42ef-8518-5bf2c5691271 on hv-cinder-85931 Sep 26 18:06:18.684687 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-55cedaa9-3c44-4cb2-a1a9-3d473f1d3c43 req-1e37615a-4675-4dee-80e0-5bc548a72dfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049137 Sep 26 18:06:18.685688 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 584/1136] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:19.494044 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:19.494657 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:19.500950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.501470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.501904 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.502594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.503046 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.503470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.647926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:19.656086 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-80b3267f-5ca2-4333-9834-32448b801dd1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.165844 Sep 26 18:06:19.656654 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 553/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:19 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:20.681995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:20.681995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:20.692413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.692784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.693243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.694094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.694547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.694966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.832541 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:20.840456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aeca07b5-186f-4011-b690-8d31644e95b7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.165145 Sep 26 18:06:20.842355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 585/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:20 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:21.292140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3b360572-04ed-42a2-842c-8bae041af362 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Action: 'create', calling method: .version_select at 0x7ff981ea6d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1624464472", "metadata": {"Type": "work"}}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:21.863431 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:21.864046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:21.870510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.870997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.871433 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:21.872122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.872575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.873001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:21.931709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3b360572-04ed-42a2-842c-8bae041af362 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.771518 Sep 26 18:06:21.932469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 554/1139] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 18:06:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 773 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 18:06:21.948384 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-91df33f0-0c42-490f-a20e-2a1655857c25 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff9821121f0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:22.001795 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-91df33f0-0c42-490f-a20e-2a1655857c25 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 200 len: 353 microversion: 2.1 time: 0.057361 Sep 26 18:06:22.002366 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 555/1140] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:06:21 2022] GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:22.011313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:22.019123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b435cde9-9912-401b-a1c5-7397e5ec6ec1 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.160037 Sep 26 18:06:22.020055 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 586/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:21 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:23.017447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-aa5eff1e-f2ed-478e-9001-70111847bdf2 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff981c78ee0>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.043927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.044709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:23.051908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.052402 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.052849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.053589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.054051 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.054483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.067891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-aa5eff1e-f2ed-478e-9001-70111847bdf2 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 200 len: 354 microversion: 2.1 time: 0.055880 Sep 26 18:06:23.068463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 556/1142] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:23.081915 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-931f9c28-68bd-4921-b431-0e3a15ec8826 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff982112d30>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.138121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-931f9c28-68bd-4921-b431-0e3a15ec8826 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 200 len: 354 microversion: 2.1 time: 0.054144 Sep 26 18:06:23.138121 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 557/1143] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:23.151859 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d8ac312c-4ed7-430f-b032-cdac2e04af3d tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff981c40310>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.209939 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:23.217624 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-eebff28f-aa9b-4ef5-a69e-f886d84e4971 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.178473 Sep 26 18:06:23.218192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 587/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:23.364412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d8ac312c-4ed7-430f-b032-cdac2e04af3d tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 202 len: 0 microversion: 2.1 time: 0.216773 Sep 26 18:06:23.365073 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 558/1145] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 18:06:23 2022] DELETE /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:06:23.373067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fbc23111-1683-4d65-9864-8728bea8d9de tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff981e371f0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.419616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fbc23111-1683-4d65-9864-8728bea8d9de tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 200 len: 353 microversion: 2.1 time: 0.050407 Sep 26 18:06:23.420175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 588/1146] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:24.018408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.019205 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=6 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.023846 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:24.026403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:24.033895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.034385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.034826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.035531 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.036160 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.036625 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.066457 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6610f9ee-f971-484a-aac6-a820bb182e20 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048847 Sep 26 18:06:24.067013 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 559/1147] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 18:06:24 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:24.130503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:24.131017 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:24.136970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.137493 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.137933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.138626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.139078 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.139504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.165206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:06:24.239646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:24.240309 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:24.246245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.246733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.247225 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.247919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.248380 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.248810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.377912 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:24.387652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4927d5b3-d878-4461-b13b-9d1103cd976a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.151921 Sep 26 18:06:24.388275 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 560/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:24 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:24.434396 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c9380018-16fd-483c-a5cd-9e3b212ca383 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Calling method '.version_select at 0x7ff982112940>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:24.455882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8f77ed15-a247-4178-afd1-b9908b7eed6c tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 204 len: 0 microversion: 2.20 time: 0.329552 Sep 26 18:06:24.456479 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 589/1149] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 18:06:24 2022] DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:06:24.465246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-c9380018-16fd-483c-a5cd-9e3b212ca383 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] HTTP exception thrown: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. Sep 26 18:06:24.465791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c9380018-16fd-483c-a5cd-9e3b212ca383 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Request method failure captured: Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 HTTP/1.1 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMeodrFBIXeBKQMB8_ELWIL-gEui0qYmcIJ7u9E49ze5qTGBR64si3jbFjh6neYrsR3GYmVbLlHjv2ePvmo326M2N2aZRJt_6cR3soAI_LHeIbAqprwuA1KtWik1ckhTSB32Tm0Kgk0vEdbpgwhjLFUrUe_ncBS5JbfBeqChh3IJQRP4 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 3bf2b0571bc1495cbd5a3f17ec550570 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-VolumesGetTestJSON-785237513 Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:24.466234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3bf2b0571bc1495cbd5a3f17ec550570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3bf2b0571bc1495cbd5a3f17ec550570"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3bf2b0571bc1495cbd5a3f17ec550570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3bf2b0571bc1495cbd5a3f17ec550570"}]}] Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-VolumesGetTestJSON-785237513 Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 3bf2b0571bc1495cbd5a3f17ec550570 Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-VolumesGetTestJSON-785237513 Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-VolumesGetTestJSON-785237513-project Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 61dbb367110647e8b3b438715aff6f10 Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-VolumesGetTestJSON-785237513-project Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'ae892be3-9506-427a-bfb1-d0b03d855e88'} Sep 26 18:06:24.467893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. (HTTP 404) (Request-ID: req-f1d048ec-03cf-4734-8bdc-a524a5d36056) Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:24.469447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:06:24.470876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 18:06:24.472361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. Sep 26 18:06:24.473755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:24.474660 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:24.475245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c9380018-16fd-483c-a5cd-9e3b212ca383 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] Returning 404 to user: Volume ae892be3-9506-427a-bfb1-d0b03d855e88 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:24.475245 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c9380018-16fd-483c-a5cd-9e3b212ca383 tempest-VolumesGetTestJSON-785237513 tempest-VolumesGetTestJSON-785237513-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88" status: 404 len: 109 microversion: 2.1 time: 0.037791 Sep 26 18:06:24.475441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.475441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.475441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.475441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.476054 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.476185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 561/1150] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 18:06:24 2022] GET /compute/v2.1/os-volumes/ae892be3-9506-427a-bfb1-d0b03d855e88 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:06:24.476279 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.619682 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:24.628162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:24.629779 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:24.630989 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-83d9e7f6-f522-4861-8c4c-e2bd1e8dc242 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.169812 Sep 26 18:06:24.631553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 590/1151] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:24 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:06:24.740820 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88ca258-66e6-42ef-8518-5bf2c5691271", "name": "network-vif-plugged", "status": "completed", "tag": "5696c8c8-93a9-4883-bc51-f80cb0320f31"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:24.748651 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.754392 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.755002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.755443 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.759436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.766530 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] Creating event network-vif-plugged:5696c8c8-93a9-4883-bc51-f80cb0320f31 for instance b88ca258-66e6-42ef-8518-5bf2c5691271 on hv-cinder-85931 Sep 26 18:06:24.773212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-721cf1d5-cae3-40ef-96c1-483d9be255b7 req-106ef9dc-8d8c-441f-83f4-b4de6fdb01bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Sep 26 18:06:24.773212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 562/1152] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:25.410527 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:25.411133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:25.413102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=4 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:25.418391 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.418906 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.419344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.420026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.420474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.420895 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.561138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:25.564755 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:25.569337 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1890aa4a-1df1-4e40-9425-b8473d1fdd48 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.163296 Sep 26 18:06:25.570858 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 591/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:25 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:25.658997 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:25.659661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:25.666692 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.671536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.671536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.671536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.671536 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.672571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.804774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:25.813301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:25.814767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:25.815974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ab340bec-90e5-43ad-9282-d1df499fa81d tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.163532 Sep 26 18:06:25.816758 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 563/1154] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:25 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:26.592775 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:26.594211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:26.601196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.601902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.602340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.603731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.604476 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.605166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.756589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:26.764743 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a11be435-22c5-4f8f-b4a5-a11d82864121 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.176547 Sep 26 18:06:26.765330 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 592/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:26 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:26.843119 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:26.844303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:26.852244 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.852730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.853170 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.853893 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.854345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.854772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.989048 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:26.997746 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:26.999209 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:27.000383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-59295fcf-18f2-428c-b299-c08919eff87b tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1722 microversion: 2.20 time: 0.161501 Sep 26 18:06:27.000939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 564/1156] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:26 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:27.245824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6baf32-af4c-4b68-99f5-ce32e42e917c", "name": "network-vif-deleted", "tag": "fbc9979b-8c95-48ea-b2f1-0efc9810462e"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:27.257445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:27.258073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:27.258581 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:27.272139 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] Creating event network-vif-deleted:fbc9979b-8c95-48ea-b2f1-0efc9810462e for instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c on hv-cinder-85931 Sep 26 18:06:27.277776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-5970e991-3fc9-4071-a777-4c664bd2fe3a req-43b48ea9-0847-4731-86f7-f4d203a9939f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038652 Sep 26 18:06:27.278909 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 593/1157] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:27.790803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:27.791773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:27.804439 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:27.809670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:27.810731 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:27.811717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:27.813800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:27.816829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:27.990079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:27.998127 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bb752ea8-4850-4aa9-818a-e49674438ad7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1313 microversion: 2.1 time: 0.212668 Sep 26 18:06:27.998702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 565/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:27 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:28.027101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:28.027919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:28.035260 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:28.035838 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:28.036285 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.036997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:28.037480 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:28.037938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.079549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:28.080038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:28.080485 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.080937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lazy-loading 'fault' on Instance uuid 5b6baf32-af4c-4b68-99f5-ce32e42e917c {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:28.126840 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:28.136097 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:28.137635 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e18ae5c3b0d54666afc4b308831edf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b37d85a344b1791fcdff859318e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:28.139138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-9cde1a71-de09-4304-8b18-c42b73785d3e tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 200 len: 1370 microversion: 2.20 time: 0.116645 Sep 26 18:06:28.141365 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 594/1159] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:28 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:29.021265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:29.021983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:29.028591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.029106 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.029571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.030269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.030726 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.031150 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.160773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:29.167577 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:29.168196 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:29.168923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fa4fd518-118f-492b-8f45-4290b80a43cb tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1498 microversion: 2.1 time: 0.151520 Sep 26 18:06:29.169605 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 566/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:29 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:29.174761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.175266 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.175683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.176381 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.176833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.177292 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.191796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c HTTP/1.1 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:29.196008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:29.197495 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '5b6baf32-af4c-4b68-99f5-ce32e42e917c'} Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:29.198282 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:29.199477 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:29.200598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:29.200598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a50deceb-931d-4a3f-a498-0c8fd283a0aa tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 404 len: 111 microversion: 2.20 time: 0.031881 Sep 26 18:06:29.200598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 595/1161] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:29 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:06:29.204881 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bf7e2eb9-6810-4a4b-857d-a2b726520fd5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '.version_select at 0x7ff981ea6820>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:29.302626 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bf7e2eb9-6810-4a4b-857d-a2b726520fd5 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933359251" status: 204 len: 0 microversion: 2.20 time: 0.102160 Sep 26 18:06:29.303217 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 567/1162] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Sep 26 18:06:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933359251 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:06:30.075390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:30.076166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:30.082490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:30.083048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:30.087088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:30.087088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:30.087088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:30.087088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:30.114068 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:06:30.427269 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e1fe292c-c269-4c73-ac4a-a032630248e2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 204 len: 0 microversion: 2.1 time: 0.355524 Sep 26 18:06:30.427926 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 596/1163] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:30 2022] DELETE /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:06:30.436704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:30.437493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:30.443476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:30.443961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:30.444405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:30.445103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:30.445594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:30.446021 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:30.574189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:30.582628 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-20616ccb-40b9-4bc8-ae35-b8b9647683fe tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1504 microversion: 2.1 time: 0.150329 Sep 26 18:06:30.583209 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 568/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:30 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:31.434410 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:31.434984 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:31.441344 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.441820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.442255 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.442938 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.443412 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.443835 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.456851 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c HTTP/1.1 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:31.458542 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.460224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '5b6baf32-af4c-4b68-99f5-ce32e42e917c'} Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:31.461138 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.462790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.464104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:31.464104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7c9c84d7-3a5c-411b-97a2-a6aab13c96e9 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 404 len: 111 microversion: 2.20 time: 0.029753 Sep 26 18:06:31.464104 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 597/1165] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 18:06:31 2022] DELETE /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:06:31.468474 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:31.469597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 5b6baf32-af4c-4b68-99f5-ce32e42e917c] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:31.475959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.476436 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.476870 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.477597 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.479676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.479676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.492318 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c HTTP/1.1 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:31.494007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.495754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '5b6baf32-af4c-4b68-99f5-ce32e42e917c'} Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:31.496633 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. Sep 26 18:06:31.498262 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:31.499837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 5b6baf32-af4c-4b68-99f5-ce32e42e917c could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:31.499837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-249af236-918c-4364-a086-c40399814b68 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c" status: 404 len: 111 microversion: 2.20 time: 0.030708 Sep 26 18:06:31.499837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 569/1166] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:31 2022] GET /compute/v2.1/servers/5b6baf32-af4c-4b68-99f5-ce32e42e917c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:06:31.611117 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:31.611768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:31.617823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.618307 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.618764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.619449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.619896 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.620318 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.755289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:31.762996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e1f1a3f8-2a3b-4c46-bd4a-514b04bb90a3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1504 microversion: 2.1 time: 0.155866 Sep 26 18:06:31.763549 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 598/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:31 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:32.786886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:32.787532 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:32.794005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.794485 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.794924 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.795611 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.796070 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.796494 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.924304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:32.931919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-531c43be-943f-4443-943c-ccdf05d734c7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1504 microversion: 2.1 time: 0.148880 Sep 26 18:06:32.932675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 570/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:32 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:33.955294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:33.955920 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:33.958401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:33.963187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:33.963671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:33.964112 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:33.964810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:33.965373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:33.965806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.097198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:34.104732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-806dbe19-2722-4b94-a130-2dd05d8058b4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1504 microversion: 2.1 time: 0.153870 Sep 26 18:06:34.105301 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 599/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:33 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:34.861389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:34.862508 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:34.868428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.868914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.869393 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.870093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.870549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.870977 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.885078 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace HTTP/1.1 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:06:34.886715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.888454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '9689462a-a796-4f06-b20f-00ba7a46cace'} Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:34.889363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.891280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.896769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:34.896769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3e235345-0c93-46d1-86c6-3ebf6a1bf1b3 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 404 len: 111 microversion: 2.20 time: 0.030895 Sep 26 18:06:34.896769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 571/1170] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 18:06:34 2022] DELETE /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:06:34.898096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:34.898704 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] [instance: 9689462a-a796-4f06-b20f-00ba7a46cace] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:34.905124 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.905615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.906600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.907313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.907768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.908251 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.921871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] HTTP exception thrown: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Request method failure captured: Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace HTTP/1.1 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMegO42subOxLUpe8o4c-mvM6ku39aQB6L0lyzJgObLN94dOwoLvCIT_0ly56hDEs5Ol8NiksyG5uHsZlrHsKxQ_KTjbMdJOmvyLO0fl2-FWxpUteo171Dc4YopZko4f-iM4-5OEB6mntZtS2qLbAtH7IPxoqngU8JJxR1-10mUgBQ-U Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:34.923430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/641b37d85a344b1791fcdff859318e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_641b37d85a344b1791fcdff859318e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/641b37d85a344b1791fcdff859318e42"}]}] Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 641b37d85a344b1791fcdff859318e42 Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826671233 Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: e18ae5c3b0d54666afc4b308831edf04 Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826671233-project Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.925037 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '9689462a-a796-4f06-b20f-00ba7a46cace'} Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:34.926004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. Sep 26 18:06:34.927394 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:34.928492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] Returning 404 to user: Instance 9689462a-a796-4f06-b20f-00ba7a46cace could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:34.928492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3c7b29d1-c6af-4c31-a594-cddac3e7a229 tempest-AttachVolumeShelveTestJSON-1826671233 tempest-AttachVolumeShelveTestJSON-1826671233-project] 10.222.0.49 "GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace" status: 404 len: 111 microversion: 2.20 time: 0.030887 Sep 26 18:06:34.928492 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 600/1171] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:34 2022] GET /compute/v2.1/servers/9689462a-a796-4f06-b20f-00ba7a46cace => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:06:35.128475 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:35.129564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:35.137980 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.138778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.139567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.141199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.141862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.142583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.219362 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88ca258-66e6-42ef-8518-5bf2c5691271", "name": "network-vif-deleted", "tag": "5696c8c8-93a9-4883-bc51-f80cb0320f31"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:35.244494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.245128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.245720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.262462 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] Creating event network-vif-deleted:5696c8c8-93a9-4883-bc51-f80cb0320f31 for instance b88ca258-66e6-42ef-8518-5bf2c5691271 on hv-cinder-85931 Sep 26 18:06:35.270991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-ad60a1de-308f-4336-b480-2953a57ae20d req-7d8ee793-51fa-4b4c-877c-fb66f3b82313 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053416 Sep 26 18:06:35.272064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 601/1172] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:35.460279 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:35.470952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4bd7025e-fd8a-405d-95da-91052ca055e3 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 200 len: 1462 microversion: 2.1 time: 0.346778 Sep 26 18:06:35.475142 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 572/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:35 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 1462 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:36.495568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:36.496280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: b88ca258-66e6-42ef-8518-5bf2c5691271] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:36.503509 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.504002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.504450 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.505150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.505996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.506428 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.521932 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] HTTP exception thrown: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Request method failure captured: Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 HTTP/1.1 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMeoTTq6K5Rh9PCexW-oF1ZGsl1bUXRyJPh00955qrnBMo4Ozm7APeu_sguBpTacTztDRoQmNMkbBHWd2ltWrPae3ZmyzRzQGAE3nIwA00OcktuSXoeGBTOECpnYxK9KVchilD438givtEErBly8MXvPy2LI8-287gujXEhmTXs8t6bo Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: f9a05f1b4598419ab701bec55add1318 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:36.524599 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f9a05f1b4598419ab701bec55add1318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f9a05f1b4598419ab701bec55add1318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f9a05f1b4598419ab701bec55add1318"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f9a05f1b4598419ab701bec55add1318"}]}] Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: f9a05f1b4598419ab701bec55add1318 Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesActionsTest-2090213357-project Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 3d349e5a507c425fab173cc785bd679a Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesActionsTest-2090213357-project Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. Sep 26 18:06:36.526304 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': 'b88ca258-66e6-42ef-8518-5bf2c5691271'} Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:36.539253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. Sep 26 18:06:36.540947 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:36.542353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Returning 404 to user: Instance b88ca258-66e6-42ef-8518-5bf2c5691271 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:36.542353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2b393216-2144-4338-8c3a-945aaf43f5ba tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271" status: 404 len: 111 microversion: 2.1 time: 0.035085 Sep 26 18:06:36.542353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 602/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:36 2022] GET /compute/v2.1/servers/b88ca258-66e6-42ef-8518-5bf2c5691271 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:06:36.671176 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-587981201", "imageRef": "cb262f5c-0490-4b4b-aec3-54f77d884fb8", "flavorRef": "452", "networks": [{"uuid": "f37f73d5-5123-4050-b2dd-1ab07f5e6540"}]}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:36.749560 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.network.neutron [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] validate_networks() for [('f37f73d5-5123-4050-b2dd-1ab07f5e6540', None, None, None, None, None)] {{(pid=132948) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:06:37.298716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Flavor limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:06:37.299145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Image limits 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:06:37.299625 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Flavor pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:06:37.300038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Image pref 0:0:0 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:06:37.300451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.virt.hardware [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:06:37.310480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:37.311732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:37.311732 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:37.312832 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:37.313516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:37.313955 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:37.331772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Getting quotas for project f9a05f1b4598419ab701bec55add1318. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:06:37.336087 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Getting quotas for user 3d349e5a507c425fab173cc785bd679a and project f9a05f1b4598419ab701bec55add1318. Resources: {'ram', 'instances', 'cores'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:06:37.348718 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Going to run 1 instances... {{(pid=132948) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:06:37.351371 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb262f5c-0490-4b4b-aec3-54f77d884fb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:06:37.510668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-c8af9775-9099-47b9-a769-2e1ee41a6b85 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850492 Sep 26 18:06:37.511592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 573/1175] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:06:37.524040 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d8dd536f-f558-47d0-b634-2de3cbbf5cc2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:37.527084 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d8dd536f-f558-47d0-b634-2de3cbbf5cc2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:37.592553 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d8dd536f-f558-47d0-b634-2de3cbbf5cc2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:37.607593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d8dd536f-f558-47d0-b634-2de3cbbf5cc2 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1213 microversion: 2.1 time: 0.084493 Sep 26 18:06:37.607593 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 603/1176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:37 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:38.629363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:38.629363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:38.642634 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.643172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.643827 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.644716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.645716 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.646412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.737774 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:38.750052 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0068205a-fe60-4d40-b253-18dbab391de7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1217 microversion: 2.1 time: 0.126200 Sep 26 18:06:38.762793 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 574/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:38 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:39.777198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:39.778456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:39.798585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.799090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.799530 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.800248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.800960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.801674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.893586 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:39.901582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ff095b13-67b8-45f1-b8d9-027077b20d7d tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1273 microversion: 2.1 time: 0.129342 Sep 26 18:06:39.902401 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 604/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:39 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:40.926958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:40.926958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:40.935541 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.936223 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.936688 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:40.938248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.938699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.939228 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.094798 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:41.104870 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-52ab013c-8d12-474c-9ce6-86080c2dd904 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.183313 Sep 26 18:06:41.105942 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 575/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:40 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:41.778622 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784256a2-4555-4817-85a0-e6e9ad9f92a4", "tag": "3e48f759-6ea5-43f6-bd3a-1cdccaeee833"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:41.790968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:41.791630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:41.792070 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.805396 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] Creating event network-changed:3e48f759-6ea5-43f6-bd3a-1cdccaeee833 for instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 on hv-cinder-85931 Sep 26 18:06:41.810386 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-d92dda53-2578-4fab-93f4-27065ff87498 req-dbe319be-de3d-48f2-bb3e-c2a66a4ee7d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Sep 26 18:06:41.811522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 605/1180] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:42.134658 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:42.135259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:42.143354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.143932 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.144373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.145357 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.145822 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.146417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.313336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:42.323725 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a9918d0e-37d5-473f-9900-5c8b33824416 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.196315 Sep 26 18:06:42.324632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 576/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:42 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:43.355280 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:43.356167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:43.363377 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.363966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.364406 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.365132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.365689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.366119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.523434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:43.533057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7f49d04f-1adb-4787-b87d-9f711fe86da9 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.181926 Sep 26 18:06:43.533849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 606/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:43 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:44.555534 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:44.556148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:44.562655 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:44.563132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:44.563566 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:44.564252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:44.564701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:44.565120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:44.704912 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:44.712563 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4a01e565-2a47-4f91-8bf5-e6ce9f5ea838 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.160881 Sep 26 18:06:44.713137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 577/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:44 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:45.736107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:45.736654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:45.743039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:45.743515 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:45.743943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:45.744653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:45.745099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:45.745545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:45.878001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:45.885942 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-900b46d5-8a27-4afa-8df8-77086cd26517 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.154556 Sep 26 18:06:45.886519 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 607/1184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:45 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:46.890482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784256a2-4555-4817-85a0-e6e9ad9f92a4", "name": "network-vif-plugged", "status": "completed", "tag": "3e48f759-6ea5-43f6-bd3a-1cdccaeee833"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:46.903272 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:46.904006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:46.904452 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:46.911073 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:46.917454 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] Creating event network-vif-plugged:3e48f759-6ea5-43f6-bd3a-1cdccaeee833 for instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 on hv-cinder-85931 Sep 26 18:06:46.917848 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:46.924283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:46.925737 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:46.926219 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:46.926933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:46.927061 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-f0aeba78-293b-427b-813f-fff05994c370 req-04911ea3-b57b-4a2b-a157-9decf3b20087 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040865 Sep 26 18:06:46.928002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 578/1185] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:46.928145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:46.928469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:47.071873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:47.080235 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7f718bb5-a80c-43ac-9aa8-e852c5db5fc7 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.173554 Sep 26 18:06:47.080801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 608/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:46 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:48.156728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:48.157579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=6 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:48.162056 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:48.162813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:48.168747 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:48.169246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:48.169711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:48.170402 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:48.170853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:48.171319 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:48.305051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:48.316363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-22f80a38-5b70-4870-a9ed-b84b340dc56e tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1313 microversion: 2.1 time: 0.157830 Sep 26 18:06:48.316363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 579/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:48 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:49.336496 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:49.337146 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:49.339289 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:49.344972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:49.345559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:49.345998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:49.346700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:49.347153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:49.347582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:49.754606 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:49.762619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f59e44d9-2d5c-4695-9381-1ea34241b875 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1498 microversion: 2.1 time: 0.429956 Sep 26 18:06:49.763175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 609/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:49 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1498 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:50.770537 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:50.771093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:50.777854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:50.778348 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:50.782212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:50.782212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:50.782212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:50.782212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:50.807028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:06:51.072322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-6530930b-9794-4d66-9782-cb5743242f7a tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "DELETE /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 204 len: 0 microversion: 2.1 time: 0.305403 Sep 26 18:06:51.072916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 580/1189] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:50 2022] DELETE /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:06:51.081291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:51.081918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:51.096847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:51.096847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:51.096847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:51.096847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:51.097206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:51.097206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:51.222123 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:51.230751 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-471a1be5-e5cb-480b-b79e-b5dd7bf335ce tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1504 microversion: 2.1 time: 0.153201 Sep 26 18:06:51.231474 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 610/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:51 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:52.254277 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:52.254992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:52.261463 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:52.261958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:52.262403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:52.263177 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:52.263648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:52.264079 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:52.279883 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:52.405711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:52.413448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f082f848-e612-4935-99ed-f960795090d6 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1504 microversion: 2.1 time: 0.163461 Sep 26 18:06:52.414054 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 581/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:52 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:53.201960 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784256a2-4555-4817-85a0-e6e9ad9f92a4", "name": "network-vif-deleted", "tag": "3e48f759-6ea5-43f6-bd3a-1cdccaeee833"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:53.212644 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:53.213151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:53.213609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:53.224999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] Creating event network-vif-deleted:3e48f759-6ea5-43f6-bd3a-1cdccaeee833 for instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 on hv-cinder-85931 Sep 26 18:06:53.230081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-80aa71dd-1f40-41a9-a70b-6a485ddcdd08 req-ac7279b3-06f4-483b-ae7e-57197dc6f29b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031790 Sep 26 18:06:53.230671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 611/1192] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:53.437354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:53.438008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:53.444405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:53.447975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:53.447975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:53.447975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:53.447975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:53.448353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:53.512062 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d349e5a507c425fab173cc785bd679a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f1b4598419ab701bec55add1318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:53.520858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9282eeb7-7e2e-4c6e-b28c-6baa6b4e1ff4 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 200 len: 1298 microversion: 2.1 time: 0.087371 Sep 26 18:06:53.524301 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 582/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:53 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:54.546567 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:54.547803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] [instance: 784256a2-4555-4817-85a0-e6e9ad9f92a4] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:54.553893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:54.554367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:54.554803 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:54.555490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:54.555943 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:54.556366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] HTTP exception thrown: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Request method failure captured: Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 HTTP/1.1 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMeoTTq6K5Rh9PCexW-oF1ZGsl1bUXRyJPh00955qrnBMo4Ozm7APeu_sguBpTacTztDRoQmNMkbBHWd2ltWrPae3ZmyzRzQGAE3nIwA00OcktuSXoeGBTOECpnYxK9KVchilD438givtEErBly8MXvPy2LI8-287gujXEhmTXs8t6bo Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: f9a05f1b4598419ab701bec55add1318 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:06:54.572320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f9a05f1b4598419ab701bec55add1318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f9a05f1b4598419ab701bec55add1318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f9a05f1b4598419ab701bec55add1318"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f9a05f1b4598419ab701bec55add1318"}]}] Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: f9a05f1b4598419ab701bec55add1318 Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-VolumesActionsTest-2090213357 Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-VolumesActionsTest-2090213357-project Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 3d349e5a507c425fab173cc785bd679a Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-VolumesActionsTest-2090213357-project Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. Sep 26 18:06:54.574101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '784256a2-4555-4817-85a0-e6e9ad9f92a4'} Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:54.575046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. Sep 26 18:06:54.576437 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:06:54.578206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] Returning 404 to user: Instance 784256a2-4555-4817-85a0-e6e9ad9f92a4 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:54.578206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0425f342-a7bd-409b-a890-81a0db92dc13 tempest-VolumesActionsTest-2090213357 tempest-VolumesActionsTest-2090213357-project] 10.222.0.49 "GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4" status: 404 len: 111 microversion: 2.1 time: 0.031285 Sep 26 18:06:54.578206 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 612/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:54 2022] GET /compute/v2.1/servers/784256a2-4555-4817-85a0-e6e9ad9f92a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:07:45.527397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:45.528040 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:45.530337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:45.530990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=9 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:45.536264 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.541950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.541950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.541950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.541950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.542345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.565855 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.objects.instance [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lazy-loading 'flavor' on Instance uuid c780d152-6fc5-47a1-91c4-e83b0e55846f {{(pid=132948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:45.945440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f45e10ee-051a-4d90-a691-fa81d677726d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "POST /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f/action" status: 202 len: 0 microversion: 2.1 time: 0.422250 Sep 26 18:07:45.946113 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 583/1195] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:07:45 2022] POST /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:07:45.955057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:45.955678 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:45.958062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=29 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:45.958722 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:45.959980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:07:45.959980 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Mon Sep 26 18:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f (ip 10.222.0.49) !!! Sep 26 18:07:45.970058 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.971278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.971278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.971724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.972185 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.972615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.250264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:46.258263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4ebb3523-44f9-4e71-90f5-46ec2c7a5cea tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.307843 Sep 26 18:07:46.258834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 613/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:45 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:47.283838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:47.284600 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:47.291383 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.291975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.292484 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.293296 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.293831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.294329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.519821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:47.527838 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4bbcf7d7-1fca-45e2-b1cd-c594fd3ecd7f tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.249655 Sep 26 18:07:47.528401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 584/1197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:47 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:48.552870 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:48.554609 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:48.562721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.563217 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.563664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.564370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.565373 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.565856 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.735605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.747050 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-967cb001-43a1-45f9-b111-16d41c59f125 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.199296 Sep 26 18:07:48.747634 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 614/1198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:48 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:49.776562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:49.777182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:49.784709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:49.785298 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:49.785723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:49.787075 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:49.787920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:49.788821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:49.956984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:49.965312 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a87f6884-fdd6-46be-8238-294f1b1240a6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.193125 Sep 26 18:07:49.966185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 585/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:49 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:50.989820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:50.990550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:51.001761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.005354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.005354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.005354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.005354 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.005751 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.166968 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:51.176455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-eb041583-6e3a-4d5f-98f4-0dc2515f3bd8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.190652 Sep 26 18:07:51.177274 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 615/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:50 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:52.200699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:52.204999 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:52.213703 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:52.214704 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:52.214969 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:52.215867 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:52.216512 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:52.217647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:52.393365 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:52.401458 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-dc1a520d-483c-4e1e-88d7-4eeafd8c4ec1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.204816 Sep 26 18:07:52.402018 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 586/1201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:52 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:53.427418 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:53.428071 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:53.436276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:53.437623 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:53.438309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:53.439312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:53.439986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:53.440789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:53.713126 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:53.721908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6f26c4a2-418d-459f-b34c-8ad2e292b0dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.300325 Sep 26 18:07:53.722420 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 616/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:53 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:54.746215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:54.746779 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:54.755757 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.756255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.756701 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.757447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.758356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.758961 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.006823 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:55.016041 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9379a8d2-8fa3-4cc2-8a8b-7fc956865d93 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.273588 Sep 26 18:07:55.021782 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 587/1203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:54 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:56.039969 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:56.040521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:56.048272 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:56.048764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:56.049430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:56.050150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:56.050608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:56.051033 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:56.224389 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:56.228923 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e2595d1a-f9e5-4c0d-a9c8-a454f538a612 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.192896 Sep 26 18:07:56.229847 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 617/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:56 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:57.252443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:57.253054 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:57.263147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.269516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.269516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.269516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.269516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.270683 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.271472 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5594ff59-4e79-449c-93e4-446312598f6d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Action: 'create', calling method: .version_select at 0x7ff981ea6790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1063502860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrOQv8Xw3i5tcIIYikmpfId66p2mZeEmi3nLJcFl2h1GzD1Gp56Xkeu/3/KtadE9/H2iYRibuZj6kDKCqUMVpsEHYsH5Dc3l8p1twttrwYnXJOSi/DsYhZ97rkLGI5+xQ=="}} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:57.299682 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-5594ff59-4e79-449c-93e4-446312598f6d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for project 6913393260144bce91945aece2aaa072. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:07:57.307594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.quota [None req-5594ff59-4e79-449c-93e4-446312598f6d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for user 88724fe08cc64b0585def01082419103 and project 6913393260144bce91945aece2aaa072. Resources: {'key_pairs'} {{(pid=132948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:07:57.387773 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5594ff59-4e79-449c-93e4-446312598f6d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.310585 Sep 26 18:07:57.388594 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 588/1205] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 18:07:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:57.435884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.444076 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fe83d0f7-f44f-47d2-a3d9-049342cfefc1 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.195693 Sep 26 18:07:57.444679 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 618/1206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:57 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:58.468337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:58.469016 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:58.476280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.476777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.477310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.477953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.478418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.478853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.621550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.630251 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-942e9710-b150-43b0-b2ee-a6795120fd71 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.165905 Sep 26 18:07:58.630937 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 589/1207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:58 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:59.655254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:59.655911 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:59.662671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.663155 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.663588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.664293 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.664736 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.665351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.885061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:59.893063 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-edf45c04-8f4d-4863-8d9e-c66ca193f87d tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.242218 Sep 26 18:07:59.901130 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 619/1208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:59 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:00.924647 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:00.925299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:00.932024 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:00.932479 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:00.933028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:00.933759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:00.934250 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:00.934676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.082624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:01.091480 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-f9c3b531-c94e-456b-8509-1cbd883dc3b7 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.170858 Sep 26 18:08:01.092583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 590/1209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:00 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:02.115985 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:02.116605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:02.123709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.124190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.124631 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.125360 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.125820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.126247 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.280161 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:02.288254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d2ec73c8-7b81-41a1-b1ce-072729f153e9 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.176187 Sep 26 18:08:02.288823 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 620/1210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:02 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:03.313608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:03.315068 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:03.321726 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.322212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.322652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.323355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.323813 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.324242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.461103 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.469777 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-98413c4f-7fba-4681-809a-a92d5c17a367 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.161667 Sep 26 18:08:03.476303 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 591/1211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:03 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:04.494664 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:04.495320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:04.502240 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.502724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.503165 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.503865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.504319 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.504749 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.647229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:04.655369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3e0db927-b6e6-485b-9337-77863f29e819 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.164630 Sep 26 18:08:04.655931 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 621/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:04 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:05.679268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:05.679891 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:05.686495 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.686983 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.687425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.688122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.688577 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.689005 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.827307 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.835502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-63fdf845-bed3-4830-837d-6e158e5798d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.160100 Sep 26 18:08:05.836163 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 592/1213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:05 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:06.859191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:06.859813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:06.865950 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.866429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.866860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.867544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.867994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.868414 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:07.000731 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:07.008461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a0567a1d-543d-4c4b-90a7-e18031bf75d6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.153188 Sep 26 18:08:07.009026 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 622/1214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:06 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:08.034092 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:08.034698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:08.037055 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=4 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:08.041862 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:08.042344 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:08.042780 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:08.043466 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:08.043917 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:08.044940 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:08.175101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:08.183700 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-55f70797-f042-45c4-b945-9bdf10a8bc3b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.153591 Sep 26 18:08:08.184255 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 593/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:08 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:09.207654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:09.208271 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:09.214721 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.215202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.215638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.217018 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.217502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.217933 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.351842 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:09.359451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-53bab170-4479-4bf1-abea-440f7c841be6 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.155680 Sep 26 18:08:09.360005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 623/1216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:09 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:10.383797 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:10.384421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:10.392148 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.392665 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.394951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:10.394951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.394951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.394951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:10.528984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:10.536809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-fb085f08-8d91-406a-9612-d86c65d12105 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.157308 Sep 26 18:08:10.542120 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 594/1217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:10 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:11.559632 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:11.560241 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:11.566874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:11.567353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:11.567784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:11.568463 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:11.568908 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:11.569369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:11.705351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:11.712936 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3ad3a26c-4b2a-43ee-9644-bc0d2c52b289 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1567 microversion: 2.1 time: 0.157084 Sep 26 18:08:11.713523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 624/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:11 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:11.736355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:11.736991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:11.743413 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:11.743898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:11.744361 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:11.745050 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:11.745602 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:11.746028 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:11.775441 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132948) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:08:12.170853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b0b463f7-e2bc-4516-afbe-a3ddf588f879 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "POST /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f/action" status: 202 len: 0 microversion: 2.1 time: 0.438311 Sep 26 18:08:12.171465 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 595/1219] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 18:08:11 2022] POST /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:08:12.179637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:12.180262 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:12.187201 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.187699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.188133 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.188884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.189367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.189789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.322113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:12.330999 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-61e691b6-91b0-4df5-aa5e-e63edbd8d9cf tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1515 microversion: 2.1 time: 0.155219 Sep 26 18:08:12.331718 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 625/1220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:12 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:13.290051 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "name": "network-vif-unplugged", "status": "completed", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:13.299809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.300276 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.300698 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.311533 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.compute.server_external_events [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] Unable to find a host for instance c780d152-6fc5-47a1-91c4-e83b0e55846f. Dropping event network-vif-unplugged {{(pid=132948) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 18:08:13.315947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-81fe0708-f09a-4972-b7c4-ea8a1a7da146 req-9c8b0220-77bd-42d5-a44f-301021eefd8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026917 Sep 26 18:08:13.315947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 596/1221] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 18:08:13.354957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:13.355481 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:13.362514 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.362990 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.363422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.364107 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.364556 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.364977 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.530147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:13.538732 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-75643ecf-90d9-4b79-b5af-7d2ea1835865 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1515 microversion: 2.1 time: 0.187716 Sep 26 18:08:13.539488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 626/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:13 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:14.562440 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:14.563077 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:14.569622 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:14.570491 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:14.570803 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:14.571516 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:14.572011 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:14.572483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:14.711352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:14.719110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bc3cdde8-beb2-4512-ae46-0e3e09b34639 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1517 microversion: 2.1 time: 0.160847 Sep 26 18:08:14.719676 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 597/1223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:14 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:15.743559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:15.744197 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:15.750674 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:15.751152 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:15.751587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:15.752277 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:15.752729 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:15.753156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:15.886361 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:15.894890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-93bb10c6-7545-4d01-9697-59636dd001b2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.155221 Sep 26 18:08:15.895472 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 627/1224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:15 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:16.920734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:16.921346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:16.927537 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.928043 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.928510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.929189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.929681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.930101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.933944 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:17.060510 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:17.068353 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ef5b6a60-c90f-437a-93b5-7d03d05aee80 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.152236 Sep 26 18:08:17.068920 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 598/1225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:16 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:17.149444 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2046873942", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1063502860", "security_groups": [{"name": "tempest-secgroup-smoke-501938319"}], "block_device_mapping_v2": [{"uuid": "a445d655-bc2e-4a3c-b50b-6fd48d0fbebc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47550a48-16b8-4cc6-b521-f81c5fc3ed86"}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:17.160313 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=31 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:17.265422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] validate_networks() for [('47550a48-16b8-4cc6-b521-f81c5fc3ed86', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:08:17.730298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:08:17.730725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:08:17.731202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:08:17.732223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:08:17.732647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:08:17.741430 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.741912 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.742351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.743109 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.743563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.743990 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.760090 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:08:17.764156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for user 88724fe08cc64b0585def01082419103 and project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:08:17.820833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:08:17.822966 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a445d655-bc2e-4a3c-b50b-6fd48d0fbebc',volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:08:18.092305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:18.093132 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:18.095808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:18.100511 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.100998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.101546 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.102248 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.102709 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.103213 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.233947 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.241551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b0254481-049d-4dd9-8a37-fe94bd79dfc8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.153834 Sep 26 18:08:18.242433 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 599/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:18 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:18.275531 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0fde6675-e253-4839-a874-b3c63a83d3fe tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.130115 Sep 26 18:08:18.276181 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 628/1227] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:08:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:08:18.288272 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bf30a112-ebeb-488a-a4f1-56644ca58f8d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:18.288984 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bf30a112-ebeb-488a-a4f1-56644ca58f8d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:18.341767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bf30a112-ebeb-488a-a4f1-56644ca58f8d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.348775 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bf30a112-ebeb-488a-a4f1-56644ca58f8d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1095 microversion: 2.1 time: 0.064795 Sep 26 18:08:18.349375 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 600/1228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:18 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:19.264605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:19.265273 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:19.271727 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.272208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.272893 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.273600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.274048 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.274470 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.278778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=93 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:19.371326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:19.371996 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:19.379352 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.379788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.380235 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.381101 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.381599 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.382216 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.408287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:19.416101 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cdac146d-8feb-46b3-92e0-cdd89c49b1dd tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.155499 Sep 26 18:08:19.429244 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 629/1229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:19 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:19.446524 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:19.454958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-15cd64a1-ddef-484b-ac45-9d0b11649766 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1145 microversion: 2.1 time: 0.087488 Sep 26 18:08:19.455535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 601/1230] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:19 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:20.439994 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:20.440568 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:20.446983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.447504 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.448167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.448871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.449351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.449786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.478075 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:20.479430 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:20.486306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.486796 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.487243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.487949 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.488403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.489039 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.569849 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.578995 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eceff4a8-237c-4986-8b98-880bf48987eb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1201 microversion: 2.1 time: 0.104791 Sep 26 18:08:20.584252 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 602/1231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:20 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:20.617391 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.625900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2daa20f9-5945-4953-a826-9997bee9d291 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.189831 Sep 26 18:08:20.626658 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 630/1232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:20 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:21.604019 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:21.604713 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:21.611935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.612405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.612854 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.613670 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.614137 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.614572 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.650574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:21.651901 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:21.661715 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.662527 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.663198 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.664132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.664796 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.665529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.790212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:21.799042 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ff7f1aba-3998-4c5a-b764-2833fa612467 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1278 microversion: 2.1 time: 0.198858 Sep 26 18:08:21.799762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 603/1233] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:21 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:21.838762 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:21.846630 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-089c1cf5-2b5f-4364-b735-b06fdef6caed tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.200314 Sep 26 18:08:21.847543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 631/1234] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:21 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:22.352505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a30bfe3-6892-4a6d-bb44-42825c8b3a31", "tag": "c51601fa-8a4d-4424-aa96-08feace3a083"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:22.362445 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.362930 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.363364 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.374671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] Creating event network-changed:c51601fa-8a4d-4424-aa96-08feace3a083 for instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 on hv-cinder-85931 Sep 26 18:08:22.382731 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-e768dad7-9c63-42b8-a7a0-ca90636003d6 req-727da018-455b-4420-abed-c83f17697479 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170421 Sep 26 18:08:22.382731 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 604/1235] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:08:22.824157 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:22.824778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:22.832398 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.832884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.833353 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.834049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.834546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.834974 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.871821 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:22.873115 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:22.879345 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.879834 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.880278 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.880990 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.881507 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.881945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.017535 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.025951 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-57a0d622-6087-4187-82e7-7f9cf7a9a7f9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.206753 Sep 26 18:08:23.027047 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 632/1236] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:22 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:23.048876 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.056687 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5a6b6d53-e0fb-4293-8bfc-d871ebb6c151 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.189654 Sep 26 18:08:23.057269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 605/1237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:22 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:24.049972 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:24.050545 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:24.056789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.057291 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.057723 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.058440 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.058886 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.059331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.080405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:24.081025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:24.087405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.087892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.088334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.089072 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.089565 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.089998 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.237914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:24.245810 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-1f65b421-9afb-48c5-b01a-fdc15a1f19a5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.199708 Sep 26 18:08:24.246374 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 633/1238] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:24 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:24.266878 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:24.275053 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5eb4875b-a7d1-4f34-966d-90ab8e8378e4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.198531 Sep 26 18:08:24.278841 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 606/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:24 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:25.268591 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:25.269209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:25.280232 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.280991 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.281808 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.283098 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.283927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.284697 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.300012 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:25.300634 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:25.307417 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.308207 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.308653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.310027 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.310493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.310954 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.489211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:25.492742 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:25.498448 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e0e0ab71-816e-4a18-9748-4b4cc7f3cb54 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.233765 Sep 26 18:08:25.499248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 634/1240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:25 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:25.501356 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-ab60cb87-e882-4f47-8a8f-4b758fa1190b tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.205294 Sep 26 18:08:25.504470 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 607/1241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:25 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:25.566478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "name": "network-vif-plugged", "status": "completed", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:25.577881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.578111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.578543 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.589309 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] Creating event network-vif-plugged:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:08:25.595135 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-fa4aff8a-6656-4fd2-97d0-5af5d0742c86 req-f5598c58-2e0c-4c20-b457-86e3acfdfe3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094614 Sep 26 18:08:25.595824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 635/1242] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:26.521426 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:26.522099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:26.527175 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:26.527880 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:26.528791 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:26.529299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:26.529737 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.530435 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:26.530884 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:26.531304 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.534173 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:26.534653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:26.535088 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.535776 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:26.536231 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:26.536653 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.727469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:26.731592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:26.735241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0bdaec4f-6b73-475d-bf5c-c1dc10d742c3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.217820 Sep 26 18:08:26.735811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 608/1243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:26 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:26.739592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f7eaf664-f15f-41c1-8c45-582eb9146f08 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1573 microversion: 2.1 time: 0.217299 Sep 26 18:08:26.740148 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 636/1244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:26 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:27.759112 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:27.759767 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:27.763287 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:27.763914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:27.766016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:27.767172 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.767668 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.768111 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.768811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.769299 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.769748 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.770014 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=6 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:27.771524 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.772040 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.772802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.773527 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.775366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.775366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.959975 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:27.968469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:27.969182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-0177fb9a-449f-4ab2-8875-066e5772b406 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.213470 Sep 26 18:08:27.969872 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 609/1245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:27 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:27.976382 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d97e5183-4ade-4f66-8b6c-a1bcb49a4d44 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1560 microversion: 2.1 time: 0.217766 Sep 26 18:08:27.977144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 637/1246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:27 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:28.991788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:28.992408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:28.994467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:28.999853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:29.000338 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:29.000780 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:29.001505 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:29.001989 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:29.002421 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:29.131343 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:29.139030 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e41cb7ad-af9c-4c65-aa36-4a551dd2d7c8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.151245 Sep 26 18:08:29.139607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 610/1247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:28 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:30.161971 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:30.162587 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:30.170503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:30.170503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:30.170503 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:30.171219 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:30.171544 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:30.171865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:30.298827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:30.306521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e2b1fc2f-0669-48fd-812a-e83c944e85b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.148442 Sep 26 18:08:30.307089 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 638/1248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:30 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:31.329321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:31.329963 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:31.336270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:31.336760 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:31.337254 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:31.337967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:31.338428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:31.338857 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:31.474377 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:31.483114 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4cb83f71-cd3a-4098-81dd-b3f160eb1c6e tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.157680 Sep 26 18:08:31.483829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 611/1249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:31 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:32.506016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:32.506652 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:32.513314 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:32.513797 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:32.514228 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:32.514919 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:32.515392 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:32.515818 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:32.644689 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:32.653303 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8dfc843c-8830-4be7-9116-ca83bdf7c633 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.150651 Sep 26 18:08:32.653873 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 639/1250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:32 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:33.487734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a30bfe3-6892-4a6d-bb44-42825c8b3a31", "name": "network-vif-plugged", "status": "completed", "tag": "c51601fa-8a4d-4424-aa96-08feace3a083"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:33.497646 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:33.502696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:33.502696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:33.509089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] Creating event network-vif-plugged:c51601fa-8a4d-4424-aa96-08feace3a083 for instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 on hv-cinder-85931 Sep 26 18:08:33.514118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-970891f7-aa38-4cf1-a170-54171f767c41 req-3ddbb48b-786a-4a37-90fe-1938785bc215 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029990 Sep 26 18:08:33.514589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 612/1251] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:33.675626 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:33.676376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:33.682786 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:33.683264 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:33.683700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:33.684384 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:33.684834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:33.685286 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:33.816254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:33.823986 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-f6e076f7-e10a-4ddc-aace-64edf8da2869 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.152289 Sep 26 18:08:33.824573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 640/1252] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:33 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:34.848560 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:34.849282 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:34.855306 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:34.855788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:34.856222 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:34.856918 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:34.857401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:34.857828 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:34.989764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:34.997871 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4257c991-6bba-4092-a5cf-e180d05d1936 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1266 microversion: 2.1 time: 0.154101 Sep 26 18:08:34.998434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 613/1253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:34 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:36.021565 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:36.022449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:36.028860 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.029379 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.029849 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.030551 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.031007 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.031434 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.157156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:36.164865 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-6a523870-b1ca-47d3-8c29-fa91dd3d0448 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1454 microversion: 2.1 time: 0.147278 Sep 26 18:08:36.165457 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 641/1254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:36 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:36.187808 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:36.188428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:36.194772 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.195256 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.195699 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.196390 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.196843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.197297 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.326442 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:36.334202 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7e8327ba-1577-4228-81e3-3d58224bb0ec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1454 microversion: 2.1 time: 0.150839 Sep 26 18:08:36.334770 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 614/1255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:36 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:38.769452 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a30bfe3-6892-4a6d-bb44-42825c8b3a31", "tag": "c51601fa-8a4d-4424-aa96-08feace3a083"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:38.782650 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:38.783150 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:38.783562 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:38.794708 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] Creating event network-changed:c51601fa-8a4d-4424-aa96-08feace3a083 for instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 on hv-cinder-85931 Sep 26 18:08:38.800069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-9df155db-b12c-4a53-b679-cca355234a08 req-6ba56799-a7d4-4a96-aae0-75b62bb412c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089519 Sep 26 18:08:38.800997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 642/1256] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:48.333728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=33 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:48.337762 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=87 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:48.338572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:48.340418 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:48.340950 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:48.344460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:48.345464 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=75 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:48.348042 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:48.348534 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:48.348972 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:48.350064 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:48.350529 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:48.350958 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:48.351328 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:48.351807 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:48.352245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:48.365339 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] Creating event network-changed:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:09:48.370507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-49d24d30-4a41-48d4-ad41-a4ca2a079259 req-be52f1e9-00b9-400a-b6c8-30306e04b537 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036824 Sep 26 18:09:48.371113 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 643/1257] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:48.378212 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:48.705323 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-477d2272-d382-4b4a-b194-9add0d0d7ee8 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 204 len: 0 microversion: 2.1 time: 0.373474 Sep 26 18:09:48.706157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 615/1258] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:09:48 2022] DELETE /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:48.716967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:48.718676 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:48.725533 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:48.725904 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:48.726335 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:48.727024 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:48.727647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:48.728147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:48.862355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:48.871528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-22a7c455-a988-4273-9ee7-0daa10ffbbcb tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.160992 Sep 26 18:09:48.875005 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 644/1259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:48 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:49.902329 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:49.902957 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:49.910285 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:49.910778 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:49.911354 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:49.912065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:49.912569 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:49.913122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:50.048574 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:50.056401 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3cd5ef54-3d28-49f6-ae9a-2b2e82c72ea0 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1566 microversion: 2.1 time: 0.158431 Sep 26 18:09:50.057007 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 616/1260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:49 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:51.065466 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780d152-6fc5-47a1-91c4-e83b0e55846f", "name": "network-vif-deleted", "tag": "31307d50-e542-4868-bd34-9450071b5b52"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:51.075647 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:51.076128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:51.076611 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:51.081270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:51.081270 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:51.087408 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:51.087886 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:51.088518 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:51.088702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] Creating event network-vif-deleted:31307d50-e542-4868-bd34-9450071b5b52 for instance c780d152-6fc5-47a1-91c4-e83b0e55846f on hv-cinder-85931 Sep 26 18:09:51.089088 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:51.089579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:51.090002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:51.094501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-e32081b1-1d67-4c2f-9b0c-f2c919c90906 req-2345f161-a799-446b-a29d-807ad8e0598f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Sep 26 18:09:51.102550 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 645/1261] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:51.155540 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:51.163281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5670c4f2-5aaa-48da-a924-144f87d89570 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1380 microversion: 2.1 time: 0.087174 Sep 26 18:09:51.163853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 617/1262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:51 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:52.188640 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:52.189371 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:52.195584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:52.196067 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:52.196508 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:52.197369 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:52.197774 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:52.198205 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:52.229179 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:52.229625 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:52.230062 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:52.230540 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lazy-loading 'fault' on Instance uuid c780d152-6fc5-47a1-91c4-e83b0e55846f {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:52.273703 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad574850851d48f29cdb17bb26149c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b90dee570a4fd4bb2c5dafcfcd3c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:52.282096 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b4c004e7-c8d0-4d2a-bebb-d895be231f33 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 200 len: 1224 microversion: 2.1 time: 0.098730 Sep 26 18:09:52.282728 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 646/1263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:52 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:53.305249 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:53.305888 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] [instance: c780d152-6fc5-47a1-91c4-e83b0e55846f] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:53.312953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.313464 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.313901 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.314591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.315047 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.315473 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.330684 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] HTTP exception thrown: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Request method failure captured: Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f HTTP/1.1 Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMemp_sqMaG1ZA-obOhy9a3KVS3pdVg--Xasb39o3I6wXM-6UOchHNThoNRtc2fpEbGqWd76_788hTx-EraYTqBjxuA7o3QYMoRh5yS8CQhIYDIOpH1Y8KIlSf60e1ZSDxcE6eAsqeh2gKaRu2IcD27lfyXmsNh-loPHar7HHUdjuH9I Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 50b90dee570a4fd4bb2c5dafcfcd3c6c Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-TestShelveInstance-1336207520 Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:09:53.332305 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50b90dee570a4fd4bb2c5dafcfcd3c6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50b90dee570a4fd4bb2c5dafcfcd3c6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_50b90dee570a4fd4bb2c5dafcfcd3c6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/50b90dee570a4fd4bb2c5dafcfcd3c6c"}]}] Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-TestShelveInstance-1336207520 Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 50b90dee570a4fd4bb2c5dafcfcd3c6c Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-TestShelveInstance-1336207520 Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-TestShelveInstance-1336207520-project Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: ad574850851d48f29cdb17bb26149c30 Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-TestShelveInstance-1336207520-project Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. Sep 26 18:09:53.334122 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'c780d152-6fc5-47a1-91c4-e83b0e55846f'} Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:53.335241 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. Sep 26 18:09:53.336936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:09:53.338469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Returning 404 to user: Instance c780d152-6fc5-47a1-91c4-e83b0e55846f could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:53.338469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-4c7e4e13-93dc-47c1-b858-601a5049d5a4 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f" status: 404 len: 111 microversion: 2.1 time: 0.032369 Sep 26 18:09:53.338469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 618/1264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:53 2022] GET /compute/v2.1/servers/c780d152-6fc5-47a1-91c4-e83b0e55846f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:09:53.577554 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4b0b2a7b-accc-4d3d-9b90-8a740caf28c2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] Calling method '.version_select at 0x7ff981b08670>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:53.653975 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4b0b2a7b-accc-4d3d-9b90-8a740caf28c2 tempest-TestShelveInstance-1336207520 tempest-TestShelveInstance-1336207520-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327912498" status: 202 len: 0 microversion: 2.1 time: 0.080376 Sep 26 18:09:53.654559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 647/1265] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 18:09:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327912498 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:10:36.022527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:36.023169 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:36.025333 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:36.025985 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:36.031403 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:36.035232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:36.035232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:36.035232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:36.035232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:36.035630 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:36.058831 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:10:36.341409 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5fc87136-7e3e-4238-a5c8-5fb7a8d1b6bf tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 204 len: 0 microversion: 2.1 time: 0.322662 Sep 26 18:10:36.342017 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 619/1266] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:36 2022] DELETE /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:10:36.347764 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=18 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:36.350081 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:36.353083 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:36.353744 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:36.360237 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:36.360724 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:36.361170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:36.361900 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:36.362356 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:36.362784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:36.494997 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:36.504049 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-7e0d4f37-3b5d-425b-bf27-c1bc56321627 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1579 microversion: 2.1 time: 0.157722 Sep 26 18:10:36.504791 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 648/1267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:36 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:37.532281 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:37.532987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:37.539341 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:37.539826 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:37.540265 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:37.540966 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:37.541451 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:37.541934 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:37.672437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:37.680160 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d1dfa30d-d29d-4648-9c74-467ecc4dbaa3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1579 microversion: 2.1 time: 0.152189 Sep 26 18:10:37.680715 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 620/1268] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:37 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:38.704914 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:38.706528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:38.713570 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:38.714147 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:38.714668 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:38.715446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:38.716057 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:38.716594 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:38.784513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:38.797174 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a1f30057-c735-4862-9806-ce77a945f5b4 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1512 microversion: 2.1 time: 0.096929 Sep 26 18:10:38.797781 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 649/1269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:38 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:38.943959 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a30bfe3-6892-4a6d-bb44-42825c8b3a31", "name": "network-vif-deleted", "tag": "c51601fa-8a4d-4424-aa96-08feace3a083"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:38.953939 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:38.954892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:38.954892 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:38.966146 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] Creating event network-vif-deleted:c51601fa-8a4d-4424-aa96-08feace3a083 for instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 on hv-cinder-85931 Sep 26 18:10:38.971415 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-e04cd7ca-33fb-4a27-87e9-a512663da898 req-12b1556f-e053-4f40-9c0c-340e2591d204 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031135 Sep 26 18:10:38.971992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 621/1270] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:39.821366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:39.821995 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:39.828713 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:39.829502 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:39.829944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:39.830657 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:39.831114 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:39.831546 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:39.864229 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:39.864717 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:39.865156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:39.865636 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lazy-loading 'fault' on Instance uuid 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:10:39.909560 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:39.917596 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e0af2dce-78e4-4551-b0d9-1c57c7a771fb tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 200 len: 1231 microversion: 2.1 time: 0.100150 Sep 26 18:10:39.918178 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 650/1271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:39 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:40.942198 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:40.942913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:40.949008 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:40.949525 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:40.949974 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:40.950671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:40.951129 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:40.951564 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:40.964373 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] HTTP exception thrown: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Request method failure captured: Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 HTTP/1.1 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMep2GvcGiRzQq6hFDZK1tUWTo5H3pIyxQCKeLdkOW3zlZiLuYldsQsvpOVIGS7lNYorN6L6mwI5CaRJ0hK1N6WoYNEM6A0pCZ_73BvOpiiTGBlQ8LNQuEOfM2PfXes1miL5biHGi-hYq1QgZeymNSuOBeR9TY_RNQJyRvIyNj-SSIBw Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:10:40.966002 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6913393260144bce91945aece2aaa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6913393260144bce91945aece2aaa072"}]}] Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 88724fe08cc64b0585def01082419103 Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:10:40.968259 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '2a30bfe3-6892-4a6d-bb44-42825c8b3a31'} Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:40.969362 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:10:40.971098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:10:40.972582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Returning 404 to user: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:40.972582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-840e2564-48f6-4155-af6b-3ce96d0fa174 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 404 len: 111 microversion: 2.1 time: 0.029924 Sep 26 18:10:40.972582 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 622/1272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:40 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:41.121761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2000541244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1063502860", "security_groups": [{"name": "tempest-secgroup-smoke-501938319"}], "block_device_mapping_v2": [{"uuid": "a445d655-bc2e-4a3c-b50b-6fd48d0fbebc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47550a48-16b8-4cc6-b521-f81c5fc3ed86"}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:41.234145 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] validate_networks() for [('47550a48-16b8-4cc6-b521-f81c5fc3ed86', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:10:41.592854 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:10:41.593311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:10:41.593790 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:10:41.594200 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:10:41.594616 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:10:41.603366 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.603846 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.604283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.605008 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.605497 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.605924 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.622061 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:10:41.626558 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for user 88724fe08cc64b0585def01082419103 and project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:10:41.684170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:10:41.686902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a445d655-bc2e-4a3c-b50b-6fd48d0fbebc',volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:10:42.114566 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-dfa68458-a188-42c5-94df-a5e82e815025 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996630 Sep 26 18:10:42.115131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 651/1273] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:10:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:10:42.126895 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-7466e310-76af-4a1c-a300-13d84ab288ee tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:42.128104 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-7466e310-76af-4a1c-a300-13d84ab288ee tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:42.180324 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-7466e310-76af-4a1c-a300-13d84ab288ee tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:42.187624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-7466e310-76af-4a1c-a300-13d84ab288ee tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1095 microversion: 2.1 time: 0.065217 Sep 26 18:10:42.188182 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 623/1274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:42 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:43.210649 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ab4f0a94-35d7-4890-bda4-8093297c2e65 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:43.211263 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ab4f0a94-35d7-4890-bda4-8093297c2e65 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:43.267086 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ab4f0a94-35d7-4890-bda4-8093297c2e65 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:43.274212 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ab4f0a94-35d7-4890-bda4-8093297c2e65 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1095 microversion: 2.1 time: 0.067948 Sep 26 18:10:43.274768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 652/1275] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:43 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:44.295733 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d274249e-6c83-41d2-bfb0-6bc63547a929 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:44.296346 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d274249e-6c83-41d2-bfb0-6bc63547a929 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:44.348840 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d274249e-6c83-41d2-bfb0-6bc63547a929 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:44.355694 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d274249e-6c83-41d2-bfb0-6bc63547a929 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1095 microversion: 2.1 time: 0.063792 Sep 26 18:10:44.356242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 624/1276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:44 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:45.378881 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fe4a3d87-d2af-4336-8ed7-502f6e4577ff tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:45.379483 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fe4a3d87-d2af-4336-8ed7-502f6e4577ff tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:45.431039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fe4a3d87-d2af-4336-8ed7-502f6e4577ff tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:45.438272 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fe4a3d87-d2af-4336-8ed7-502f6e4577ff tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1095 microversion: 2.1 time: 0.063302 Sep 26 18:10:45.438833 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 653/1277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:45 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:46.461478 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:46.462220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:46.469652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:46.470139 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:46.470576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:46.471280 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:46.471734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:46.472194 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:46.530916 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:46.538459 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-beb5d437-c34a-402e-8862-0b27ca256b80 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1145 microversion: 2.1 time: 0.080952 Sep 26 18:10:46.539025 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 625/1278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:46 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:47.561922 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:47.562617 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:47.569046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:47.569564 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:47.570004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:47.570699 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:47.571154 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:47.571584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:47.636850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:47.645350 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-4f56a3f5-7844-438e-adfb-e7d4251b9d35 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1193 microversion: 2.1 time: 0.087821 Sep 26 18:10:47.646211 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 654/1279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:47 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:48.674363 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:48.690381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:48.690381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:48.690381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:48.690381 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:48.690856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:48.690856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:48.690856 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:48.745788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:48.754776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-10eacdef-3076-44db-bf0b-bd0251c0ab75 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1211 microversion: 2.1 time: 0.084604 Sep 26 18:10:48.754776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 626/1280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:48 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:49.778446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:49.779064 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:49.785488 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:49.788970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:49.788970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:49.788970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:49.788970 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:49.789417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:49.916038 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:49.924002 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-2a98ad45-b4b8-4cf9-871b-cc18ea141ffc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.149313 Sep 26 18:10:49.924585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 655/1281] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:49 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:49.933843 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42d602d-f71c-430c-822c-dcfd6df12d43", "tag": "87f64aa4-756a-4be9-b8f0-cdff72cecb83"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:49.944809 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:49.950502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:49.950502 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:49.959951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] Creating event network-changed:87f64aa4-756a-4be9-b8f0-cdff72cecb83 for instance b42d602d-f71c-430c-822c-dcfd6df12d43 on hv-cinder-85931 Sep 26 18:10:49.964962 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-f25c8d37-d59e-4b2b-93b8-be63b25bfda5 req-36fa28e7-bd57-45e0-966c-ee928999e1f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034817 Sep 26 18:10:49.965591 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 627/1282] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:50.947572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:50.948390 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:50.955446 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:50.955927 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:50.956358 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:50.957039 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:50.957522 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:50.957940 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:51.091156 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:51.099478 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b535e3d7-a258-4912-953a-25bd66290bad tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.155808 Sep 26 18:10:51.100065 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 656/1283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:50 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:52.123967 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:52.124660 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:52.130722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:52.131200 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:52.131659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:52.132347 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:52.132800 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:52.133243 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:52.261091 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:52.269624 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-134725cf-554d-4729-9f62-155b79fc37dc tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.150870 Sep 26 18:10:52.270179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 628/1284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:52 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:53.291882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:53.292501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:53.294367 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:53.299855 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.304850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.304850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.304850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.304850 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.305276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.431584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:53.439663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-09cbc0af-d1c6-41d9-8537-d53abf6b7fec tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.151627 Sep 26 18:10:53.440245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 657/1285] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:53 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:54.462914 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:54.463539 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:54.465938 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=4 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:54.471246 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.471734 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.472223 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.472927 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.473422 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.474065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.607187 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:54.615089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9c135361-3d4f-4ade-aa1f-b92fff406e7a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.156134 Sep 26 18:10:54.615653 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 629/1286] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:54 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:55.638523 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:55.639153 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:55.641510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=10 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:55.647655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.647655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.647655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:55.648122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.648573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.649001 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:55.777559 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:55.785759 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-ce38928b-30e0-4197-9117-dbc6cd4bd55f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.151188 Sep 26 18:10:55.802340 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 658/1287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:55 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:56.809310 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:56.809936 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:56.816898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:56.817437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:56.817882 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:56.818579 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:56.819037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:56.819469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:56.950987 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:56.958575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-85c6d859-903f-4b93-9d0a-b79afb656e01 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.153377 Sep 26 18:10:56.959133 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 630/1288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:56 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:57.981813 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:57.982589 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:57.988829 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:57.989370 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:57.989964 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:57.991720 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:57.992192 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:57.992627 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:58.127249 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:58.134965 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-cc6a7006-acb1-4a93-a069-531403980f8c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.157479 Sep 26 18:10:58.135521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 659/1289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:57 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:59.159790 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:59.160405 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:59.166887 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:59.169026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:59.169026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:59.169026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:59.169026 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:59.169589 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:59.299481 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:59.307085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eea311c4-c3b2-4de1-b58c-c78cbfe88bb5 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.151258 Sep 26 18:10:59.307663 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 631/1290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:59 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:00.120119 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42d602d-f71c-430c-822c-dcfd6df12d43", "name": "network-vif-plugged", "status": "completed", "tag": "87f64aa4-756a-4be9-b8f0-cdff72cecb83"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:00.132036 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:00.132527 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:00.132963 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:00.144529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] Creating event network-vif-plugged:87f64aa4-756a-4be9-b8f0-cdff72cecb83 for instance b42d602d-f71c-430c-822c-dcfd6df12d43 on hv-cinder-85931 Sep 26 18:11:00.149709 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-78fb5c80-bbde-43ca-bedf-d9e9fd6231af req-128a1da6-96cc-40b2-81d3-e8ec8007b80b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Sep 26 18:11:00.150259 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 660/1291] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:00.330447 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:00.331218 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:00.337722 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:00.338326 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:00.338776 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:00.339483 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:00.339943 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:00.340378 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:00.472656 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:00.482334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-a4b8f31a-41a8-44c5-9885-56393f6a546d tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.156223 Sep 26 18:11:00.482923 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 632/1292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:00 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:01.507520 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:01.508223 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:01.514528 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:01.515004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:01.515438 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:01.516128 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:01.516600 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:01.517004 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:01.644814 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:01.652598 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5ebe080e-1919-4837-9040-bf6a407107ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1266 microversion: 2.1 time: 0.149756 Sep 26 18:11:01.653375 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 661/1293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:01 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:02.675702 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:02.676321 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:02.683185 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.683674 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.684110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.684811 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.685788 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.686220 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.817719 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:02.825423 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3c803848-cb62-4d55-98a2-4fa78e4211b7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1453 microversion: 2.1 time: 0.153528 Sep 26 18:11:02.826110 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 633/1294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:02 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:02.847320 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:02.847937 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:02.854413 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.854892 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.855325 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.856016 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.856506 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.857441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.983254 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:02.990902 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-a62034bd-aaf6-4be3-869b-50f8b950fdae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1453 microversion: 2.1 time: 0.147417 Sep 26 18:11:02.991507 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 662/1295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:02 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:05.137504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42d602d-f71c-430c-822c-dcfd6df12d43", "tag": "87f64aa4-756a-4be9-b8f0-cdff72cecb83"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:05.147765 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:05.148232 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:05.148860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:05.160152 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] Creating event network-changed:87f64aa4-756a-4be9-b8f0-cdff72cecb83 for instance b42d602d-f71c-430c-822c-dcfd6df12d43 on hv-cinder-85931 Sep 26 18:11:05.165199 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-b5836732-ef55-4e34-ac41-d83e11a3e14d req-5256b002-31cd-4134-ba2a-1eaf4314c2ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031539 Sep 26 18:11:05.165825 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 634/1296] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:43.778700 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:43.779451 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=72 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:43.781294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:12:43.781460 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Mon Sep 26 18:12:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.49) !!! Sep 26 18:12:43.786521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1663810739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1063502860", "security_groups": [{"name": "tempest-secgroup-smoke-501938319"}], "block_device_mapping_v2": [{"uuid": "533b3882-4c73-4fe3-8fb5-6f62af990864", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47550a48-16b8-4cc6-b521-f81c5fc3ed86"}]}} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:43.903788 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.network.neutron [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] validate_networks() for [('47550a48-16b8-4cc6-b521-f81c5fc3ed86', None, None, None, None, None)] {{(pid=132949) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:12:44.265180 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:12:44.265646 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image limits 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:12:44.266111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Flavor pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:12:44.266513 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Image pref 0:0:0 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:12:44.267183 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.virt.hardware [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:12:44.275778 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:44.276253 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:44.276685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:44.277441 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:44.277890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:44.278312 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:44.294976 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:12:44.298944 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.quota [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Getting quotas for user 88724fe08cc64b0585def01082419103 and project 6913393260144bce91945aece2aaa072. Resources: {'ram', 'instances', 'cores'} {{(pid=132949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:12:44.357512 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Going to run 1 instances... {{(pid=132949) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:12:44.359725 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='533b3882-4c73-4fe3-8fb5-6f62af990864',volume_size=None,volume_type=None)] {{(pid=132949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:12:44.865702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-5d78090c-5942-43f3-b4d0-93a62ed8f5ed tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.088531 Sep 26 18:12:44.867784 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 663/1297] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 18:12:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:12:44.877337 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:44.878080 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:44.879167 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:12:44.879322 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Mon Sep 26 18:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 (ip 10.222.0.49) !!! Sep 26 18:12:44.880355 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:12:44.880482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Mon Sep 26 18:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 (ip 10.222.0.49) !!! Sep 26 18:12:44.886269 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3e734db6-eef4-4c0b-8220-b710e963b9b3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:44.886970 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3e734db6-eef4-4c0b-8220-b710e963b9b3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:44.944089 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3e734db6-eef4-4c0b-8220-b710e963b9b3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:44.951211 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3e734db6-eef4-4c0b-8220-b710e963b9b3 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1095 microversion: 2.1 time: 0.075975 Sep 26 18:12:44.951784 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 635/1298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:44 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:45.977490 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:45.978422 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:45.985170 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:45.985681 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:45.986122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:45.986817 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:45.987276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:45.987701 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:46.048510 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:46.056521 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-8cfa7a5a-589f-4b90-ba6f-b021ee3d8e90 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1145 microversion: 2.1 time: 0.083605 Sep 26 18:12:46.057102 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 664/1299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:45 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:47.080898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:47.081549 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:47.089608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:47.090098 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:47.090551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:47.091242 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:47.091741 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:47.092107 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:47.158134 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:47.166751 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-b2fcaf12-5d3d-4ea0-a808-986c761396a7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1201 microversion: 2.1 time: 0.090600 Sep 26 18:12:47.167711 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 636/1300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:47 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:48.191831 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:48.192548 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:48.199673 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.200167 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.200608 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.201355 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.201816 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.202248 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.519583 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:48.520707 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-fdf15788-c14a-48a6-88ab-b0ce9f158a4f tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1278 microversion: 2.1 time: 0.332757 Sep 26 18:12:48.521311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 665/1301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:48 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:48.965196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979b1557-6fef-4c40-9e69-bc11186cf1b1", "tag": "11c858fe-e064-48ff-a724-44a09eb5eeab"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:48.976424 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.976986 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.977526 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.988991 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] Creating event network-changed:11c858fe-e064-48ff-a724-44a09eb5eeab for instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 on hv-cinder-85931 Sep 26 18:12:48.993913 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-42215b36-3d79-49f2-9660-99a062eb82ef req-29ff2009-3158-438b-8ccb-6ff9c2d6e06f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Sep 26 18:12:48.994523 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 637/1302] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:49.544187 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:49.544757 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:49.551077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:49.551563 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:49.552046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:49.552695 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:49.553144 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:49.553619 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:49.688294 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:49.696095 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-027c014c-ac49-4845-b855-f39c08806eae tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.155946 Sep 26 18:12:49.696662 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 666/1303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:49 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:50.720500 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:50.721196 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:50.727314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:50.727785 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:50.728218 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:50.728900 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:50.729382 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:50.729806 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:50.910951 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:50.919336 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3c4fd7bf-454d-4048-b81f-2328977d6939 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.203500 Sep 26 18:12:50.919851 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 638/1304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:50 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:51.942469 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:51.943094 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:51.949592 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:51.950077 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:51.950516 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:51.951213 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:51.951763 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:51.952787 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:52.078806 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:52.086429 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-d5ee39cd-d858-4147-9f51-9e6e6f573284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.147888 Sep 26 18:12:52.086998 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 667/1305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:51 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:53.109764 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:53.110385 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:53.117059 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:53.117607 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:53.118049 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:53.118745 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:53.119215 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:53.119645 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:53.247184 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:53.255334 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-5c4152f3-17ea-478c-9877-33a86fbcd590 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.150013 Sep 26 18:12:53.255898 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 639/1306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:53 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:54.278190 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:54.278824 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:54.284376 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=2 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:54.285871 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:54.286342 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:54.286770 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:54.287445 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:54.287891 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:54.288310 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:54.305761 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell0:SELECT=6 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:54.451393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:54.451393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-29a21f0a-266c-4cf9-a72e-c46e6cd92284 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.161637 Sep 26 18:12:54.451393 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 668/1307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:54 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:55.461678 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:55.462171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:55.464575 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell0:SELECT=2 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:55.469469 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:55.473860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:55.473860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:55.473860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:55.473860 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:55.474268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:55.603929 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:55.611071 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-3011f735-d0be-4a95-a261-5597b7da1287 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.153651 Sep 26 18:12:55.611629 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 640/1308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:55 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:56.634202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:56.634820 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:56.642283 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:56.642768 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:56.643207 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:56.647983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:56.647983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:56.647983 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:57.050449 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:57.058311 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-71edfaf0-a2df-4ed0-940c-41bb67e63cb8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.428108 Sep 26 18:12:57.060890 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 669/1309] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:56 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:58.136119 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:58.136835 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:58.143550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:58.144038 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:58.144482 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:58.145179 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:58.145667 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:58.146099 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:58.276894 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:58.284695 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-bf044f39-1d38-4c42-8cf0-11e82eb39a46 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.206395 Sep 26 18:12:58.285275 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 641/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:58 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:58.787773 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979b1557-6fef-4c40-9e69-bc11186cf1b1", "name": "network-vif-plugged", "status": "completed", "tag": "11c858fe-e064-48ff-a724-44a09eb5eeab"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:58.798327 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:58.798802 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:58.799243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:58.810091 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] Creating event network-vif-plugged:11c858fe-e064-48ff-a724-44a09eb5eeab for instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 on hv-cinder-85931 Sep 26 18:12:58.815243 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-64934015-637c-47a1-b803-841b3843fb80 req-01aa4c3c-957d-4b31-b5ac-47b7865936cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 Sep 26 18:12:58.815766 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 670/1311] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:59.307659 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:59.308283 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:59.315222 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:59.315708 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:59.316157 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:59.316853 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:59.317340 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:59.317769 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:59.446945 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:59.455151 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d64fc820-f27b-49e0-b776-335b524e886c tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1266 microversion: 2.1 time: 0.151411 Sep 26 18:12:59.455730 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 642/1312] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:59 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:00.478882 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:00.479582 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:00.486041 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:00.486529 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:00.486967 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:00.487663 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:00.488122 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:00.489278 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:00.618716 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:00.626605 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-3bb6281b-f058-4f89-af37-968699b164a9 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1453 microversion: 2.1 time: 0.152476 Sep 26 18:13:00.627168 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 671/1313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:00 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:00.649268 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:00.649905 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:00.656234 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:00.657302 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:00.657754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:00.658450 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:00.658976 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:00.659339 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:00.791583 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:00.799810 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9acbb94f-9aa5-450b-a7b1-472de039f0a8 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1453 microversion: 2.1 time: 0.154363 Sep 26 18:13:00.800397 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 643/1314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:00 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:02.720669 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979b1557-6fef-4c40-9e69-bc11186cf1b1", "tag": "11c858fe-e064-48ff-a724-44a09eb5eeab"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:02.730572 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:02.731022 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:02.731455 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:02.743423 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] Creating event network-changed:11c858fe-e064-48ff-a724-44a09eb5eeab for instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 on hv-cinder-85931 Sep 26 18:13:02.748884 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-41b6732a-1328-43ca-a365-1eb7cd5c0334 req-0f00343e-3e95-4cf1-ad5a-8944684c2555 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031495 Sep 26 18:13:02.749042 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 672/1315] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:42.528755 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_api:SELECT=20 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:42.530644 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG dbcounter [-] [132948] Writing DB stats nova_cell1:SELECT=44 {{(pid=132948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:42.531160 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:42.532053 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG dbcounter [-] [132949] Writing DB stats nova_cell1:SELECT=48 {{(pid=132949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:42.535858 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:42.536671 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:42.544428 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.545194 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.545728 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:42.546562 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.547093 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.547603 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:42.575135 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Going to try to terminate instance {{(pid=132948) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:14:42.605323 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979b1557-6fef-4c40-9e69-bc11186cf1b1", "tag": "11c858fe-e064-48ff-a724-44a09eb5eeab"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:42.615953 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.616547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.616894 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:42.633789 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] Creating event network-changed:11c858fe-e064-48ff-a724-44a09eb5eeab for instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 on hv-cinder-85931 Sep 26 18:14:42.635883 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-53065116-c8e9-4d7a-8fb5-908b9df1e8a4 req-1d5b5742-14c2-4a51-b2d7-1bd6ddfd6803 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106457 Sep 26 18:14:42.637044 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 673/1316] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:42.905118 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-9930d235-c626-4ee2-90d1-aef6c563c6b2 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 204 len: 0 microversion: 2.1 time: 0.378876 Sep 26 18:14:42.911926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 644/1317] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:14:42 2022] DELETE /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:14:42.917099 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:42.917877 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:42.924874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.925424 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.925841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:42.926547 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.926996 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.927417 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:43.064879 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:43.073208 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-93746b0a-c80b-4a64-bd4a-e96c9f9f4998 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1578 microversion: 2.1 time: 0.160782 Sep 26 18:14:43.073841 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 674/1318] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:42 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:14:44.098425 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:44.099125 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:44.106153 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:44.106632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:44.107065 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:44.107759 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:44.108214 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:44.108648 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:44.248988 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:44.256140 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d8fb7a83-34c3-4a13-acff-cc4d98c0de43 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1578 microversion: 2.1 time: 0.161962 Sep 26 18:14:44.256754 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 645/1319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:44 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:45.046918 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979b1557-6fef-4c40-9e69-bc11186cf1b1", "name": "network-vif-deleted", "tag": "11c858fe-e064-48ff-a724-44a09eb5eeab"}]} {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:45.060132 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.060615 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.061046 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.073913 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.compute.server_external_events [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] Creating event network-vif-deleted:11c858fe-e064-48ff-a724-44a09eb5eeab for instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 on hv-cinder-85931 Sep 26 18:14:45.080224 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [req-080a849c-f4ca-491b-a081-7f3189dcd826 req-fcfd9058-1d4e-419f-a5d6-0498f2e8a371 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Sep 26 18:14:45.081306 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 675/1320] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:14:45.281490 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:45.282288 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:45.288551 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.289037 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.289504 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.290206 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.294130 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.294130 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.360661 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:45.373406 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e3799c79-d102-4624-b5ef-b1eb434e0285 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1226 microversion: 2.1 time: 0.096870 Sep 26 18:14:45.373953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 646/1321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:45 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:46.397494 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:46.398191 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:46.405202 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.409456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.409456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.409456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.409456 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.409957 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.450140 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.450702 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.451225 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.451827 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.objects.instance [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lazy-loading 'fault' on Instance uuid 979b1557-6fef-4c40-9e69-bc11186cf1b1 {{(pid=132949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:14:46.498637 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:46.507685 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-0277b738-b63c-43a9-a3f1-b2d073871f3a tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 200 len: 1231 microversion: 2.1 time: 0.114848 Sep 26 18:14:46.512501 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 676/1322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:46 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:47.532394 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:47.533006 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 979b1557-6fef-4c40-9e69-bc11186cf1b1] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:47.540953 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:47.541476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:47.541908 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:47.542723 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:47.543171 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:47.543592 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:47.557652 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] HTTP exception thrown: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Request method failure captured: Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 HTTP/1.1 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMep2GvcGiRzQq6hFDZK1tUWTo5H3pIyxQCKeLdkOW3zlZiLuYldsQsvpOVIGS7lNYorN6L6mwI5CaRJ0hK1N6WoYNEM6A0pCZ_73BvOpiiTGBlQ8LNQuEOfM2PfXes1miL5biHGi-hYq1QgZeymNSuOBeR9TY_RNQJyRvIyNj-SSIBw Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:14:47.559328 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6913393260144bce91945aece2aaa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6913393260144bce91945aece2aaa072"}]}] Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 88724fe08cc64b0585def01082419103 Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. Sep 26 18:14:47.561535 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '979b1557-6fef-4c40-9e69-bc11186cf1b1'} Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:14:47.562571 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. Sep 26 18:14:47.564675 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:47.566437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Returning 404 to user: Instance 979b1557-6fef-4c40-9e69-bc11186cf1b1 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:14:47.566437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-d617c719-0663-4a3f-8d2d-5898748087a1 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1" status: 404 len: 111 microversion: 2.1 time: 0.032453 Sep 26 18:14:47.566437 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 647/1323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:47 2022] GET /compute/v2.1/servers/979b1557-6fef-4c40-9e69-bc11186cf1b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:14:51.029426 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:51.030801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:51.031192 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42d602d-f71c-430c-822c-dcfd6df12d43", "tag": "87f64aa4-756a-4be9-b8f0-cdff72cecb83"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:51.038345 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:51.038834 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:51.039331 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:51.040111 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:51.040574 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:51.041069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:51.049919 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:51.051090 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:51.052386 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:51.074744 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] Creating event network-changed:87f64aa4-756a-4be9-b8f0-cdff72cecb83 for instance b42d602d-f71c-430c-822c-dcfd6df12d43 on hv-cinder-85931 Sep 26 18:14:51.080620 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Going to try to terminate instance {{(pid=132949) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:14:51.081412 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-fb2e04d9-8646-4279-9954-6975e1a5fed1 req-b6d6e1c5-151f-4fdd-a686-24f346460433 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053597 Sep 26 18:14:51.082289 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 648/1324] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:51.392475 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-e1c184f0-6a71-41ee-b291-fc4bf90ccd39 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 204 len: 0 microversion: 2.1 time: 0.367427 Sep 26 18:14:51.393461 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 677/1325] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:14:51 2022] DELETE /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:14:51.402632 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:51.403378 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:51.409783 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:51.410314 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:51.410794 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:51.411567 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:51.412274 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:51.412712 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:51.555550 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.policy [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132948) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:51.564837 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-471326b0-06e9-4185-bb77-fd901ea01d23 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1578 microversion: 2.1 time: 0.166830 Sep 26 18:14:51.565467 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 649/1326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:51 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:52.589735 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:52.590443 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:52.597638 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:52.598131 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:52.598573 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:52.599276 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:52.599730 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:52.600162 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:52.737801 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:52.745671 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-152197bb-71e4-4058-9f9b-13d13189faa7 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1578 microversion: 2.1 time: 0.160712 Sep 26 18:14:52.746242 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 678/1327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:52 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:53.395448 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42d602d-f71c-430c-822c-dcfd6df12d43", "name": "network-vif-deleted", "tag": "87f64aa4-756a-4be9-b8f0-cdff72cecb83"}]} {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:53.405935 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:53.406389 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:53.406829 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:53.419799 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.compute.server_external_events [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] Creating event network-vif-deleted:87f64aa4-756a-4be9-b8f0-cdff72cecb83 for instance b42d602d-f71c-430c-822c-dcfd6df12d43 on hv-cinder-85931 Sep 26 18:14:53.424952 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [req-7ec48c49-5ac1-4dd1-8ef0-de6d4a0f06c9 req-bd057a2b-c6ca-44d6-bcec-654dbf4c4307 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 Sep 26 18:14:53.433476 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 650/1328] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:53.769459 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:53.770265 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:53.777575 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:53.778069 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:53.778505 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:53.779209 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:53.779654 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:53.780074 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:53.844588 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.policy [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88724fe08cc64b0585def01082419103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6913393260144bce91945aece2aaa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132949) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:53.852425 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-c8a4d5a8-8b12-4975-a4e7-ab5256cfa494 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 200 len: 1226 microversion: 2.1 time: 0.086918 Sep 26 18:14:53.853003 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 679/1329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:53 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:54.878696 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:54.879293 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: b42d602d-f71c-430c-822c-dcfd6df12d43] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:54.885948 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.886434 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.886873 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.887576 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.888029 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.888717 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.903527 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] HTTP exception thrown: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Request method failure captured: Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 HTTP/1.1 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMep2GvcGiRzQq6hFDZK1tUWTo5H3pIyxQCKeLdkOW3zlZiLuYldsQsvpOVIGS7lNYorN6L6mwI5CaRJ0hK1N6WoYNEM6A0pCZ_73BvOpiiTGBlQ8LNQuEOfM2PfXes1miL5biHGi-hYq1QgZeymNSuOBeR9TY_RNQJyRvIyNj-SSIBw Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:14:54.905145 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6913393260144bce91945aece2aaa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6913393260144bce91945aece2aaa072"}]}] Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 88724fe08cc64b0585def01082419103 Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. Sep 26 18:14:54.906815 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': 'b42d602d-f71c-430c-822c-dcfd6df12d43'} Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:14:54.907681 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. Sep 26 18:14:54.909015 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:54.910468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Returning 404 to user: Instance b42d602d-f71c-430c-822c-dcfd6df12d43 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:14:54.910468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-e68b767a-e602-45b5-8711-17b338d76b08 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43" status: 404 len: 111 microversion: 2.1 time: 0.033359 Sep 26 18:14:54.910468 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 651/1330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:54 2022] GET /compute/v2.1/servers/b42d602d-f71c-430c-822c-dcfd6df12d43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:14:55.427159 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:55.428655 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.compute.api [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132949) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:55.434245 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.434726 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.435151 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:55.435832 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.436275 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.436693 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG oslo_concurrency.lockutils [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:55.450585 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.wsgi [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] HTTP exception thrown: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Request method failure captured: Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: request: DELETE /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 HTTP/1.1 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept: application/json Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Accept-Encoding: identity Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Connection: close Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Length: 0 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Content-Type: application/json Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Host: 10.222.0.49 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: Openstack-System-Scope: None Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: User-Agent: python-urllib3/1.26.12 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Auth-Token: gAAAAABjMep2GvcGiRzQq6hFDZK1tUWTo5H3pIyxQCKeLdkOW3zlZiLuYldsQsvpOVIGS7lNYorN6L6mwI5CaRJ0hK1N6WoYNEM6A0pCZ_73BvOpiiTGBlQ8LNQuEOfM2PfXes1miL5biHGi-hYq1QgZeymNSuOBeR9TY_RNQJyRvIyNj-SSIBw Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Id: None Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Domain-Name: None Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Identity-Status: Confirmed Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Is-Admin-Project: True Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Id: default Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Domain-Name: Default Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Project-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Role: reader,member Sep 26 18:14:55.452199 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Roles: reader,member Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6913393260144bce91945aece2aaa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6913393260144bce91945aece2aaa072"}]}] Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-Tenant-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Id: default Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Domain-Name: Default Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Id: 88724fe08cc64b0585def01082419103 Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: X-User-Name: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: method: > Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: exception: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.453874 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: action_args: {'id': '2a30bfe3-6892-4a6d-bb44-42825c8b3a31'} Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:14:55.454928 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.456298 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.458351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Returning 404 to user: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. {{(pid=132949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:14:55.458351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-aa52e9a1-f734-4271-bfb0-1f93dc12c313 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 404 len: 111 microversion: 2.1 time: 0.030301 Sep 26 18:14:55.458351 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 680/1331] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 18:14:55 2022] DELETE /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:14:55.462552 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '>' {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:55.463978 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.compute.api [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] [instance: 2a30bfe3-6892-4a6d-bb44-42825c8b3a31] Fetching instance by UUID {{(pid=132948) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:55.469992 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.470493 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.470926 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:55.471608 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Acquiring lock "6eded39c-877a-426d-8a1f-1043d953fe22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.472085 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.472506 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG oslo_concurrency.lockutils [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Lock "6eded39c-877a-426d-8a1f-1043d953fe22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:55.486509 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.wsgi [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] HTTP exception thrown: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Request method failure captured: Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: request: GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 HTTP/1.1 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept: application/json Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Accept-Encoding: identity Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Connection: close Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Length: 0 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Content-Type: application/json Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Host: 10.222.0.49 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: Openstack-System-Scope: None Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: User-Agent: python-urllib3/1.26.12 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Auth-Token: gAAAAABjMep2GvcGiRzQq6hFDZK1tUWTo5H3pIyxQCKeLdkOW3zlZiLuYldsQsvpOVIGS7lNYorN6L6mwI5CaRJ0hK1N6WoYNEM6A0pCZ_73BvOpiiTGBlQ8LNQuEOfM2PfXes1miL5biHGi-hYq1QgZeymNSuOBeR9TY_RNQJyRvIyNj-SSIBw Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Id: None Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Domain-Name: None Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Identity-Status: Confirmed Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Is-Admin-Project: True Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Id: default Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Domain-Name: Default Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Project-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Role: reader,member Sep 26 18:14:55.488100 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Roles: reader,member Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6913393260144bce91945aece2aaa072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6913393260144bce91945aece2aaa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6913393260144bce91945aece2aaa072"}]}] Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Id: 6913393260144bce91945aece2aaa072 Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1369560732 Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Id: default Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Domain-Name: Default Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Id: 88724fe08cc64b0585def01082419103 Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: X-User-Name: tempest-TestVolumeBootPattern-1369560732-project Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: method: > Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: exception: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.495154 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: action_args: {'id': '2a30bfe3-6892-4a6d-bb44-42825c8b3a31'} Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: {{(pid=132948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:14:55.496159 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. Sep 26 18:14:55.498189 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: ERROR nova.api.openstack.wsgi Sep 26 18:14:55.499677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: DEBUG nova.api.openstack.wsgi [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Returning 404 to user: Instance 2a30bfe3-6892-4a6d-bb44-42825c8b3a31 could not be found. {{(pid=132948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:14:55.499677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: INFO nova.api.openstack.requestlog [None req-eb520710-9e8b-48b2-991b-79623f233163 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31" status: 404 len: 111 microversion: 2.1 time: 0.030841 Sep 26 18:14:55.499677 dv-cinder-859317-1-iscsi devstack@n-api.service[132948]: [pid: 132948|app: 0|req: 652/1332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:55 2022] GET /compute/v2.1/servers/2a30bfe3-6892-4a6d-bb44-42825c8b3a31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:14:57.006216 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: DEBUG nova.api.openstack.wsgi [None req-b79bbbdf-774b-45e6-9a9f-4737adc57799 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] Calling method '.version_select at 0x7ff981e371f0>' {{(pid=132949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:57.119584 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: INFO nova.api.openstack.requestlog [None req-b79bbbdf-774b-45e6-9a9f-4737adc57799 tempest-TestVolumeBootPattern-1369560732 tempest-TestVolumeBootPattern-1369560732-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1063502860" status: 202 len: 0 microversion: 2.1 time: 0.116827 Sep 26 18:14:57.120166 dv-cinder-859317-1-iscsi devstack@n-api.service[132949]: [pid: 132949|app: 0|req: 681/1333] 10.222.0.49 () {58 vars in 1263 bytes} [Mon Sep 26 18:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1063502860 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)